-- Logs begin at Wed 2022-07-13 09:16:43 UTC, end at Wed 2022-07-13 10:14:08 UTC. -- Jul 13 09:43:21.739852 dv-cinder-797608-57-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 13 09:43:21.750267 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 13 09:43:21 2022] *** Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: nodename: dv-cinder-797608-57-iscsi Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: machine: x86_64 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: clock source: unix Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: pcre jit disabled Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: detected number of CPU cores: 4 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: current working directory: / Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: detected binary path: /usr/bin/uwsgi-core Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: your processes number limit is 47680 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: your memory page size is 4096 bytes Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: detected max file descriptor number: 2048 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: lock engine: pthread robust mutexes Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: thunder lock: enabled Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 13 09:43:21.756440 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 13 09:43:21.797025 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: Python main interpreter initialized at 0x5559a4e749c0 Jul 13 09:43:21.797025 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: python threads support enabled Jul 13 09:43:21.797025 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: your server socket listen backlog is limited to 100 connections Jul 13 09:43:21.797025 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: your mercy for graceful operations on workers is 90 seconds Jul 13 09:43:21.797369 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 09:43:21.797443 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: *** Operational MODE: preforking *** Jul 13 09:43:21.797707 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: *** uWSGI is running in multiple interpreter mode *** Jul 13 09:43:21.797707 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: spawned uWSGI master process (pid: 80214) Jul 13 09:43:21.797919 dv-cinder-797608-57-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 13 09:43:21.798982 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: spawned uWSGI worker 1 (pid: 80222, cores: 1) Jul 13 09:43:21.798982 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: spawned uWSGI worker 2 (pid: 80223, cores: 1) Jul 13 09:43:21.798982 dv-cinder-797608-57-iscsi devstack@keystone.service[80214]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 09:43:27.131054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:43:27.131054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: from cryptography.utils import int_from_bytes Jul 13 09:43:27.131882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:43:27.131882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jul 13 09:43:27.132290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:43:27.132290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: from cryptography.utils import int_from_bytes Jul 13 09:43:27.132399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 09:43:27.132399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: from cryptography.utils import int_from_bytes Jul 13 09:43:27.180076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 09:43:27.180276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 09:43:27.180419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 09:43:27.180519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] command line args: [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 09:43:27.180633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 09:43:27.180749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 09:43:27.180834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] command line args: [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 09:43:27.180948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ================================================================================ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 09:43:27.181064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 09:43:27.181280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ================================================================================ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 09:43:27.181414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] admin_token = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.181491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.181565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config_dir = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.181762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.181885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config_dir = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.181971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] config_source = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] config_source = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] debug = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] debug = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.182952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.183885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_config_append = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_config_append = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_dir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_dir = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.184957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.185981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.186926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.187975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] publish_errors = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.188963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.17/identity {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] publish_errors = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] standard_threads = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.189954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] standard_threads = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_journal = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.190967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_json = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_stderr = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] use_syslog = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_journal = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_json = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.191979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.192092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_stderr = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.192092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] use_syslog = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.192300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.192410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 09:43:27.192528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.192647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.192766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.192879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.192996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.193909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.194936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.195968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.196956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.197995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.198931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.199955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.200816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.201909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.202958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203639 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.203933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.204876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.205960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206072 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207173 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.207950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.208992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.209909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.210982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.211989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.212932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.213878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.214972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.external = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.215923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.external = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216729 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.password = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.216954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] auth.token = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.password = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] auth.token = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.217961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.218942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219072 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.219857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.220983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.221990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.222999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.223945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224173 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.224978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.225944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.226953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.227855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228244 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228325 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.228932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.229995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.230906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.231955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.232982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.233901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.234989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.235920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.236948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.237976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.238939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.239978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.240899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.241940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.242920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.243971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.244894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.245934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.246965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.247895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.248853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.249979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.250929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.251971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.252890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.253908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.254952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.255872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.256890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.257930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.258913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.259952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.260993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.261939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.262896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.263010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.263462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.263608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.263724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.263838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.263952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.264885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.265885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.266002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.266117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.266230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.266352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.266482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 09:43:27.266599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80223) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 09:43:27.266713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80222) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 09:43:27.297294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.297482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.297643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.297728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.297792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.297910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.306576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.306793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.335154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.335389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.335513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.335650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.481709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.482084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.531896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.532127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.532797 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.533013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.598411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.598644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.598867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.599087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.599281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.599527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.599661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.599847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.600026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.600258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.600444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.600684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.624433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.624611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.624781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.624867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.624931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.625908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.637228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.637525 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.650261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.650535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.650703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.650792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.650948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80222) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.651760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.652008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80223) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 13 09:43:27.668951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.669135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 09:43:27.669571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.669830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 09:43:27.669976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.670063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 09:43:27.670205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.670318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.670462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.670654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.670804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 13 09:43:27.670889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.670963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.671204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.671465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.671706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.681654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.681922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.682186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.682444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.682567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.682820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.683089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.683368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.690755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.691804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.694019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.694297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.694597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.694876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.695238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.695925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.696996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.697188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.697459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.697711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.723003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.724423 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.724661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.724872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.726034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.726315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.730108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.730385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.730799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.731584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.732112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.732275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.738211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.738520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.739588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.739868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.742970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.743252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.743531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.743804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.744079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.744343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.744468 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.744661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.744787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.744936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.745082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.745215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.745377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.745679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.745944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.746212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.764146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.764414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.765259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.765538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.769057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.770091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.772748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.773041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.773745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.774036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.778153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.779234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.781822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.782861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.785459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.785755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.786047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.786328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.786493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.786620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.786784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.786867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.787078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.787362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.787651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.787927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.805869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.806151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.806445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.806695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.807084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.807371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.807638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.807906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.814627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.815886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.816331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.816609 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.817588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.817863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.819799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.820073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.820346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.820622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.820901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.821041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.821337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.821622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.821902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.822174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.834159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.834403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.834734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.835017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.835305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.835647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.835924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.836211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.836493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.836778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.836904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.837135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.838338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.838659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.855021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.856657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.858333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.859983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.861636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.863332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.863461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.865017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.865146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.865285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.865558 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.866742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.867064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.867354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.872923 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.874539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.875026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.876691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.877773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.878059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.878460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.878754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.879970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.880266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.880658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.880912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.887828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.888112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.888775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.890579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.890842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.891151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.896620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80222) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.896897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.897171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.897439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.897702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.898080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.898350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.898646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.898925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80223) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 13 09:43:27.899163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.899943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.900078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.900203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80222) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.900407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.900684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.900950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.901232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.901513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.901770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.902033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.902297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.902592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80223) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 13 09:43:27.938069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559a4e749c0 pid: 80222 (default app) Jul 13 09:43:27.940647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5559a4e749c0 pid: 80223 (default app) Jul 13 09:43:27.941472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd891b-2c22-41a4-8b87-0be13f91dc7f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:27.941764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd891b-2c22-41a4-8b87-0be13f91dc7f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:27.942041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd891b-2c22-41a4-8b87-0be13f91dc7f None None] PATH_INFO: `/v3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:27.946401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 791 bytes} [Wed Jul 13 09:43:27 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:35.600820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:35.601709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:35.601709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:35.609227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1/2] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:35.615449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:35.615897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:35.616021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:35.687087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: INFO dbcounter [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] Registered counter for database keystone Jul 13 09:43:35.711385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG oslo_db.sqlalchemy.engines [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80222) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:43:35.724566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writer thread running {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:43:35.922019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG passlib.handlers.bcrypt [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80222) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 09:43:35.922511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG passlib.handlers.bcrypt [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80222) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 09:43:35.977754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:35.979426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:36.110233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 09:43:36.265752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:36.341556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: INFO dbcounter [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] Registered counter for database keystone Jul 13 09:43:36.363712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG oslo_db.sqlalchemy.engines [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80223) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 09:43:36.371812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writer thread running {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 13 09:43:36.504493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ab933-0a35-44f9-9216-4a1c023b4de7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:36.510021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:36.510735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:36.511017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:36.511292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:36.521376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:36.574576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 09:43:36.574917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994408b-4c1f-42d5-b18f-04f355bb49dc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:36.586055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 2/4] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jul 13 09:43:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:43:36.595423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:36.613782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91695c-9b54-498c-8fe2-be4db9957450 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:36.623366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:36.624702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:36.625116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:36.625530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] PATH_INFO: `/v3/projects/a135dccee4ed45239317c87dab2bda38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:36.628344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] RBAC: Authorizing `identity:get_project(project_id=a135dccee4ed45239317c87dab2bda38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:36.686153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 13 09:43:36.686521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6b86a-9bc2-48fb-bfcc-c97ce3c45111 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:36.691212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 3/5] 10.222.0.17 () {56 vars in 1207 bytes} [Wed Jul 13 09:43:36 2022] GET /identity/v3/projects/a135dccee4ed45239317c87dab2bda38 => generated 344 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:38.675749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b5e7c-8927-4aaf-b245-4455f26dae00 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:38.676542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b5e7c-8927-4aaf-b245-4455f26dae00 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:38.676542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b5e7c-8927-4aaf-b245-4455f26dae00 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:38.683380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 3/6] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:38.690096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:38.690578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:38.690725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:38.714216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:38.715854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:38.724243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 4/7] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 13 09:43:38.747861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b5e7c-8927-4aaf-b245-4455f26dae00 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:38.768436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b5e7c-8927-4aaf-b245-4455f26dae00 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:38.774357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5ee28-e5dd-44af-9d67-afdd2ce9bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:38.775031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ee28-e5dd-44af-9d67-afdd2ce9bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:38.775313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ee28-e5dd-44af-9d67-afdd2ce9bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:38.775593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5ee28-e5dd-44af-9d67-afdd2ce9bf69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:38.784519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5ee28-e5dd-44af-9d67-afdd2ce9bf69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:38.786298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5ee28-e5dd-44af-9d67-afdd2ce9bf69 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:38.796057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 4/8] 10.222.0.17 () {58 vars in 1324 bytes} [Wed Jul 13 09:43:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:43:38.805077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:38.820163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc11027-127a-4d0c-b2c7-8a07cffc1f8f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:38.827864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1df74-e414-4e6b-a7df-9dc2c09346fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:38.828738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1df74-e414-4e6b-a7df-9dc2c09346fd admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:38.829024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1df74-e414-4e6b-a7df-9dc2c09346fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:38.829299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1df74-e414-4e6b-a7df-9dc2c09346fd admin admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:38.830875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1df74-e414-4e6b-a7df-9dc2c09346fd admin admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:38.832723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1df74-e414-4e6b-a7df-9dc2c09346fd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:38.834293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 5/9] 10.222.0.17 () {56 vars in 1198 bytes} [Wed Jul 13 09:43:38 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:40.930327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d415-25c8-4681-82d0-ad9adee25b6f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:40.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d415-25c8-4681-82d0-ad9adee25b6f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:40.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491d415-25c8-4681-82d0-ad9adee25b6f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:40.932279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 5/10] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:43:40.937567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:40.937995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:40.938106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:40.956021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:40.956266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189906f-566a-4ca7-ac33-65e90d7c39cd None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:40.956472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189906f-566a-4ca7-ac33-65e90d7c39cd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:40.956722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8189906f-566a-4ca7-ac33-65e90d7c39cd None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:40.957218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:40.958079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 6/11] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:43:40.963493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:40.963783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:40.964065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.004633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80223) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 13 09:43:41.005041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG passlib.handlers.bcrypt [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80223) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 13 09:43:41.044737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 6/12] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:41.050269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:41.051891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:41.067256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.093521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.159649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 7/13] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:41.175029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c4a00-02b0-491d-a346-68253453cbc7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.182838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.209881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.210574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.210849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.211128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.278084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.279658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.282087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25454714-e176-4ae9-987f-06f764e329b9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.284385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.302640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.319623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.320672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.320954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.321227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.333784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:41.345109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:41.346069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:41.346961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 8/14] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:41.352429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.380526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 7/15] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 09:43:41.386079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.456982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998b776-4fc4-4a29-8d14-e8a6491becba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.484035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bfca44-13be-4d01-a0de-d5cf06022ee7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.489971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.490679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.490959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.491239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.491994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:41.492304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.493752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.506311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 9/16] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:41.507170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.512129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.520616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.521394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.521672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.521941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.533432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.534954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.539930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:43:41.556750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:41.557614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:41.558407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:43:41.558407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:43:41.558407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:43:41.558407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:43:41.558407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 8/17] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:43:41.563939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.618372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97ef43-5e4d-4fa0-882a-590d00169659 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.651179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.652061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.652339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.652609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.654211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.655717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.657385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 10/18] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:41.662728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.663507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80817f6b-caf8-4eec-9b0a-5892f3ceb500 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.697416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.698091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.698367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.698675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.699408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:41.699715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.701167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.719520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 9/19] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:41.762642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.771971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb164118-ec3b-4d0d-b87a-4c473a1da8c6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.812216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3eeaa-2921-4613-8229-2f1e886d086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.813027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3eeaa-2921-4613-8229-2f1e886d086c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.813310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3eeaa-2921-4613-8229-2f1e886d086c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.813583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3eeaa-2921-4613-8229-2f1e886d086c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.814863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3eeaa-2921-4613-8229-2f1e886d086c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.816331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3eeaa-2921-4613-8229-2f1e886d086c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.817971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 11/20] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:41.824108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:41.865071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:41.935761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195b02b-ff10-4e3e-a9fc-e33eef1ace61 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:41.974386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:41.975029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:41.975290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:41.975569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:41.976543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.domain.id=default, user.id=7a11b13b53364a13a16a1b29e3946ed6) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:41.976723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:41.978907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204fd028-e892-4459-be8c-39b7108db163 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:41.985752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 10/21] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jul 13 09:43:41 2022] GET /identity/v3/role_assignments?user.id=7a11b13b53364a13a16a1b29e3946ed6&scope.domain.id=default&role.id=757ccd03cb5e4f109673558436a31b66 => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:43.915057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67445-b190-42d8-a229-835ae97274a6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:43.916082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67445-b190-42d8-a229-835ae97274a6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:43.916562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f67445-b190-42d8-a229-835ae97274a6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:43.918151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 12/22] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:43.923696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f4a1-c508-47d4-86ea-2b97d886830f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:43.924113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f4a1-c508-47d4-86ea-2b97d886830f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:43.924277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536f4a1-c508-47d4-86ea-2b97d886830f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:43.946273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8536f4a1-c508-47d4-86ea-2b97d886830f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:43.947517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8536f4a1-c508-47d4-86ea-2b97d886830f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:44.032152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 11/23] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:44.082140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67445-b190-42d8-a229-835ae97274a6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:44.225526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f67445-b190-42d8-a229-835ae97274a6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:44.259856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:44.261022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.261501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.261958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.280137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7692a0-d681-41ca-87ba-84f529d61065 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.280435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7692a0-d681-41ca-87ba-84f529d61065 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.280725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7692a0-d681-41ca-87ba-84f529d61065 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.282122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 12/24] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:43:44.282981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:44.284703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:44.287260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.287549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.287833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:43:44.308792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:44.309629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:44.310707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:43:44.310707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:43:44.310707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:43:44.310707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:44.318437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 13/25] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:44.319641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:44.330261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:44.331505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:44.349415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:44.398826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:44.472792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 13/26] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:44.495629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:44.508247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c8cc3-6437-4a5d-ac2f-4f330b2e01b6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:44.577905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:44.578637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.578926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.579207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.579948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:44.580310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:44.581854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:44.600314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5071365-62b4-439b-82b4-3e993fcfcade None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:44.614979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 14/27] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:44.620813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:44.642940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbfaba-f249-4b30-8cd1-59bcf4bca4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:44.643627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbfaba-f249-4b30-8cd1-59bcf4bca4b9 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.643959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbfaba-f249-4b30-8cd1-59bcf4bca4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.644242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbfaba-f249-4b30-8cd1-59bcf4bca4b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.645025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbfaba-f249-4b30-8cd1-59bcf4bca4b9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:44.646455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbfaba-f249-4b30-8cd1-59bcf4bca4b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:44.786230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:44.788529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 14/28] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 09:43:44 2022] POST /identity/v3/roles => generated 219 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:43:44.794645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2233-2f2b-4454-b072-254f2df4316f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.794945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2233-2f2b-4454-b072-254f2df4316f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.795233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d2233-2f2b-4454-b072-254f2df4316f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.796703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 15/29] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:44.803058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.803343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.803780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.832916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:44.835421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:44.861691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:44.868652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0a3c-d940-4818-8e50-3bdd963e8069 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:44.957600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ef1bf-23b1-4378-a227-783adf6ab2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:44.958302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef1bf-23b1-4378-a227-783adf6ab2a7 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:44.958827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef1bf-23b1-4378-a227-783adf6ab2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:44.959294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ef1bf-23b1-4378-a227-783adf6ab2a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:44.960107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 16/30] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:44.960647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ef1bf-23b1-4378-a227-783adf6ab2a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:44.962381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ef1bf-23b1-4378-a227-783adf6ab2a7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:44.995977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:45.143498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 15/31] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:43:44 2022] POST /identity/v3/projects => generated 301 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:43:45.145400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ce72f-c3ef-4d3d-bce4-fa0ef844a8df None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.145869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ce72f-c3ef-4d3d-bce4-fa0ef844a8df None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.146360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ce72f-c3ef-4d3d-bce4-fa0ef844a8df None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.147966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 16/32] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:45.154065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.154745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.155444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.177503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d7c78-1aa5-4ed2-80e2-742500229e46 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:45.193802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:45.197139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:45.253494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:45.254325 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.254665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.255057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.279616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:45.291721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:45.292668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:45.293406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:43:45.295884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 17/33] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:45.301960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:45.305555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 17/34] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:45.319313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:45.349072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:45.447765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:45.466058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382519ef-67dd-4189-abcb-37e5e592a646 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:45.506655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:45.507876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.508080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.508472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.509761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:45.510164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:45.512315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:45.522466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8efe8-b66b-4725-8673-b433f91238e2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:45.569856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f080a67-5da1-468b-833b-1d6341b5b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:45.570871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f080a67-5da1-468b-833b-1d6341b5b1b2 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.571297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f080a67-5da1-468b-833b-1d6341b5b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.571766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f080a67-5da1-468b-833b-1d6341b5b1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.572968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f080a67-5da1-468b-833b-1d6341b5b1b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:45.574799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f080a67-5da1-468b-833b-1d6341b5b1b2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:45.593444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 18/35] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 09:43:45 2022] POST /identity/v3/roles => generated 225 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:43:45.595145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37544-792d-4495-8d1d-8d1d4fc6320b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.595614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37544-792d-4495-8d1d-8d1d4fc6320b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.596020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a37544-792d-4495-8d1d-8d1d4fc6320b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.598047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:45.604381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.604907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.605328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.630980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:45.632653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:45.653528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 18/37] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:45.658899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:45.722442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 20/38] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:45.741339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:45.757141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:45.794276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beccd1b-f167-443b-bcd4-a636b0a52303 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:45.806454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:45.837556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:45.838472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.838763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.839040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.840264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:45.841938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:45.843816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 19/39] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:45 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:45.849109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:45.877289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c0278-1dfa-4633-ad1a-fb0f8878ad8b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:45.913008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba22c5-ab70-4e6f-b5a3-3f070f695026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:45.913680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba22c5-ab70-4e6f-b5a3-3f070f695026 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.913962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba22c5-ab70-4e6f-b5a3-3f070f695026 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.914239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba22c5-ab70-4e6f-b5a3-3f070f695026 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.915025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba22c5-ab70-4e6f-b5a3-3f070f695026 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:45.916418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba22c5-ab70-4e6f-b5a3-3f070f695026 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:45.930194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 09:43:45 2022] POST /identity/v3/roles => generated 223 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:43:45.931343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc50e6-d3c2-4999-8574-58b33ea7736d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.931635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc50e6-d3c2-4999-8574-58b33ea7736d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.931912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc50e6-d3c2-4999-8574-58b33ea7736d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.933147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 22/41] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:45.939053 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:45.939357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:45.939676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:45.957207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:45.958460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:45.966195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad1c96-db2f-42d6-9254-09fb93562b59 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:46.009139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:46.009883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:46.010172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:46.010480 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:46.011839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:46.013714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:46.015508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 20/42] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:46.021735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:46.033958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:46.035526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 23/43] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:46.061635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:46.104986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:46.146656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbf5c0-04b2-4ce4-83ae-d265c89373b2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:46.182254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c115a49-f399-4f2c-b69b-e98163508619 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:46.183993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:46.185012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:46.185304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:46.185589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] PATH_INFO: `/v3/domains/default/users/7a11b13b53364a13a16a1b29e3946ed6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:46.187651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7a11b13b53364a13a16a1b29e3946ed6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:46.189119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:46.203764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 21/44] 10.222.0.17 () {58 vars in 1361 bytes} [Wed Jul 13 09:43:46 2022] PUT /identity/v3/domains/default/users/7a11b13b53364a13a16a1b29e3946ed6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:43:46.218503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d4c1ec-32fd-4efe-a485-1801e8aab04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:46.219433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4c1ec-32fd-4efe-a485-1801e8aab04f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:46.219723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4c1ec-32fd-4efe-a485-1801e8aab04f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:46.220000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d4c1ec-32fd-4efe-a485-1801e8aab04f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:46.221293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4c1ec-32fd-4efe-a485-1801e8aab04f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:46.222817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d4c1ec-32fd-4efe-a485-1801e8aab04f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:46.224539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 24/45] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:46.230828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:46.305791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:46.344828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a41459-01b7-4658-bf19-fcc1133fa646 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:46.381587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7d3cc-e079-4aec-ab32-e935c9883c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:46.382278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d3cc-e079-4aec-ab32-e935c9883c9e None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:46.382670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d3cc-e079-4aec-ab32-e935c9883c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:46.382956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7d3cc-e079-4aec-ab32-e935c9883c9e None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:46.383698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d3cc-e079-4aec-ab32-e935c9883c9e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:46.385176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7d3cc-e079-4aec-ab32-e935c9883c9e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:46.414225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 22/46] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:43:46 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:43:48.211518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bbdfc-22b2-41a7-abb9-903a78811a01 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.212060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bbdfc-22b2-41a7-abb9-903a78811a01 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.212060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bbdfc-22b2-41a7-abb9-903a78811a01 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.213458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 25/47] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:48.218794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532a6b-13e3-4bd1-af23-196d70a30a43 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.219248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532a6b-13e3-4bd1-af23-196d70a30a43 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.219336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da532a6b-13e3-4bd1-af23-196d70a30a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.237873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-da532a6b-13e3-4bd1-af23-196d70a30a43 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:48.239086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-da532a6b-13e3-4bd1-af23-196d70a30a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:48.311575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 23/48] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:48.334118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bbdfc-22b2-41a7-abb9-903a78811a01 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:48.410593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dfb00-e778-4846-b1e2-f2c74cb4e9a1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.410883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dfb00-e778-4846-b1e2-f2c74cb4e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.411171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dfb00-e778-4846-b1e2-f2c74cb4e9a1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.412554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 24/49] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:43:48.418251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.418625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.419027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.437156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:48.438352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:48.453415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bbdfc-22b2-41a7-abb9-903a78811a01 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:48.456508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:48.483372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:48.489193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:48.490009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.490309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.490614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.501080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:48.507750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 25/50] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:48.508652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:48.509822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:48.510684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 26/51] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:43:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:48.515882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:48.531817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:48.613314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9629caee-1080-4e52-a105-b0d8614496f8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:48.632329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116b3c1-f747-4240-82e4-d1816600c9d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:48.650075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:48.650783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.651076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.651354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.652111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:48.652421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:48.653878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:48.662271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 26/52] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:48.666353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:48.667180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.667464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.667742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.667835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:48.668946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:48.670569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:48.672211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 27/53] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:48.677481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:48.709120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:48.712784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:48.785915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c865b8-cbd6-41c3-9856-38190e40fb9f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:48.789399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e1b7b-345d-4138-9fcc-6dc716793059 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:48.822242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:48.822840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:48.823154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.823543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.823639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.823827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.823914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.824115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.824819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:48.825145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:48.826307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:48.826687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:48.828359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 27/54] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:48 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:48.833706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:48.854411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 28/55] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jul 13 09:43:48 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:43:48.943795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23abe23d-fc2d-4ba8-948b-be4d3a6270ac None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:48.954345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:48.981075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63807d31-5923-488e-9f54-0e35c6a4adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:48.981956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807d31-5923-488e-9f54-0e35c6a4adf9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:48.982240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807d31-5923-488e-9f54-0e35c6a4adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:48.982552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63807d31-5923-488e-9f54-0e35c6a4adf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:48.983828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63807d31-5923-488e-9f54-0e35c6a4adf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:48.985328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63807d31-5923-488e-9f54-0e35c6a4adf9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:48.987016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 28/56] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:43:48.993034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:49.198778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:49.217490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318244ae-a211-4325-99d7-9ad760147fa3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:49.252059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:49.252725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:49.253009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:49.253325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:49.254292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.domain.id=default, user.id=7a11b13b53364a13a16a1b29e3946ed6) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:49.254631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:49.256307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7660bdc-bba2-41f3-9fe5-f2cc8d44783e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:49.266837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 29/57] 10.222.0.17 () {56 vars in 1322 bytes} [Wed Jul 13 09:43:48 2022] GET /identity/v3/role_assignments?user.id=7a11b13b53364a13a16a1b29e3946ed6&scope.domain.id=default&role.id=757ccd03cb5e4f109673558436a31b66 => generated 530 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:50.877797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b19fe-35a1-4076-97f2-1cb88f8b0804 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:50.878673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b19fe-35a1-4076-97f2-1cb88f8b0804 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:50.878782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9b19fe-35a1-4076-97f2-1cb88f8b0804 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:50.880984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 29/58] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:50.887424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:50.888690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:50.888905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:50.907311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:50.908516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:50.986305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 30/59] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:51.011848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b19fe-35a1-4076-97f2-1cb88f8b0804 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:51.129222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9b19fe-35a1-4076-97f2-1cb88f8b0804 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:51.177729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdd6d21-99fb-4f07-b393-dc891591668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:51.178574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6d21-99fb-4f07-b393-dc891591668f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:51.178859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6d21-99fb-4f07-b393-dc891591668f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:51.179135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdd6d21-99fb-4f07-b393-dc891591668f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:51.180336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6d21-99fb-4f07-b393-dc891591668f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:51.181790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdd6d21-99fb-4f07-b393-dc891591668f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:51.183444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 30/60] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:51.190167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:51.284305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:51.311363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36b994-61e3-449b-8275-af29cc2d5990 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:51.347456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22be2c-2eb6-4241-968b-c3995a9efc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:51.348150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22be2c-2eb6-4241-968b-c3995a9efc3e None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:51.348439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22be2c-2eb6-4241-968b-c3995a9efc3e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:51.348717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22be2c-2eb6-4241-968b-c3995a9efc3e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:51.349431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22be2c-2eb6-4241-968b-c3995a9efc3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:51.350932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22be2c-2eb6-4241-968b-c3995a9efc3e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:51.379985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 31/61] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:43:51 2022] POST /identity/v3/users => generated 275 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:43:54.609727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d31b-2851-4a4d-94ed-4ab9165c4945 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.610750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d31b-2851-4a4d-94ed-4ab9165c4945 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.611602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d31b-2851-4a4d-94ed-4ab9165c4945 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.613194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 31/62] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:54.618496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919550a9-fc45-4490-8c38-4cd8a2a99159 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.619402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919550a9-fc45-4490-8c38-4cd8a2a99159 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.619934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919550a9-fc45-4490-8c38-4cd8a2a99159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.625970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31cc83-44a8-46e6-ae7a-25e8b518b933 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.626458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31cc83-44a8-46e6-ae7a-25e8b518b933 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.626902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a31cc83-44a8-46e6-ae7a-25e8b518b933 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.628420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 32/63] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:43:54.642699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-919550a9-fc45-4490-8c38-4cd8a2a99159 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:54.643375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.643873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.643974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-919550a9-fc45-4490-8c38-4cd8a2a99159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:54.644459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.665873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:54.667384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:54.716015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:54.743284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 32/64] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:54.744963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80335601-3934-4922-9749-9af7569a35ee None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.745454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80335601-3934-4922-9749-9af7569a35ee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.746048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80335601-3934-4922-9749-9af7569a35ee None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.747844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 33/65] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:54.753355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.753896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.754395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.761521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 33/66] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:54.767937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:54.772806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:54.774284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:54.853923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:54.868578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 34/67] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:54.870475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:54.892519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392fbab-ecd1-4005-8b22-5599313dc1c4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:54.928638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:54.929543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:54.929996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:54.930458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:54.942322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:54.952495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:54.953445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:54.954211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:43:54.956859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 34/68] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:43:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:43:54.957822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:54.979447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124fa782-dd5c-43d1-b207-ed0484b73c12 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:54.995662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.016202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.017391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.017873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.018345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.029632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:55.037793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:55.038704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:43:55.039485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:55.041844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 35/69] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:55.042880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.077259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6c3f07-012d-4f8f-9998-0511a40c68d1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.101520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.118810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.120008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.120548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.121036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.133377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:55.144278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:55.145155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:43:55.145914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:43:55.149424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 35/70] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:43:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:55.150249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f94449-0c79-4258-af27-dd8b4c9fbef2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.150912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.185703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.186384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.186768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.186980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.187745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:55.188056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.189459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.197997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 36/71] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:55.198826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.248666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.255537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4aed1-0d16-48fa-bba5-da479116ec16 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.289270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.289932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.290217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.290527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.291281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:55.291569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.292978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c7e7c-2901-46ab-b874-0df8828ab216 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.298221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713a0357-ecff-4f7d-8ff8-a3c572ed37df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.301214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 36/72] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:55.302265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe9b5-194b-42a4-9372-cd6ecf78177d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.302590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe9b5-194b-42a4-9372-cd6ecf78177d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.302874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efe9b5-194b-42a4-9372-cd6ecf78177d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.306473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 37/73] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:55.306473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4540-17c4-4243-a249-2f5fc6016f9e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.306473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4540-17c4-4243-a249-2f5fc6016f9e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.306473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d4540-17c4-4243-a249-2f5fc6016f9e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.310465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 38/74] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:55.310465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4540-17c4-4243-a249-2f5fc6016f9e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.319322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.337984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.338684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.338986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.339269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.340024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:55.340337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.341749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.350109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:55.350975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.409854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d4540-17c4-4243-a249-2f5fc6016f9e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.444653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369cedf-b1b3-4938-be7c-74f3d4984ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.445531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369cedf-b1b3-4938-be7c-74f3d4984ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.445819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369cedf-b1b3-4938-be7c-74f3d4984ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.446092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369cedf-b1b3-4938-be7c-74f3d4984ec7 None admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.447337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369cedf-b1b3-4938-be7c-74f3d4984ec7 None admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.448806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369cedf-b1b3-4938-be7c-74f3d4984ec7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.450504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 39/76] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:55.451648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.451937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.452219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.453905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86f64c-9d65-4152-bbd0-1f8ee903198d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.467916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:55.469111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:55.486432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.490482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef9537-86f4-4847-b138-60ed3dcdb2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.491378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9537-86f4-4847-b138-60ed3dcdb2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.491666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9537-86f4-4847-b138-60ed3dcdb2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.491945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef9537-86f4-4847-b138-60ed3dcdb2f3 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.507104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef9537-86f4-4847-b138-60ed3dcdb2f3 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.508567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef9537-86f4-4847-b138-60ed3dcdb2f3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.510267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 38/77] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:55.511484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.511775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.512058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.528410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:55.529597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:55.535519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 40/78] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:55.536270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.559556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.598764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 39/79] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:55.599606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.645562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffa85df-07d7-4b7f-96f5-b07f7cce35ec None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.679088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.679905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.680198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.680476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.681686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.683175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.684868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 41/80] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:55.685804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.699913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f5cf4-efbc-4366-8860-d5cf76de3bfe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.709145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.740551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.741209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.741497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.741777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.775629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.785293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad09370f-8f77-4840-9c93-e147519234a3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:55.811677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.813185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.819143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:55.819794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:55.820078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:55.820355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:55.888045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:55.889773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:55.910676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 40/81] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:43:55.911530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:55.913781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.975935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:55.991210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 42/82] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:43:55.991210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.015175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab759c2-efc7-48ea-b899-3c0ccfd880d1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.049003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.049804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.050088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.050351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.060607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:56.068281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:56.069297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:56.070337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 41/83] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:56.071279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.089315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e156-243f-4df8-88a8-af5b26a8904c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.112190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.124303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.125105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.125394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.125660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.127138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.128596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.130378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 43/84] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:43:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.131116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.175197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9d62f-4209-47e0-b875-24c24e44d27b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.202162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.211053 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.211711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.211981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.212260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.234402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803730c9-e438-482d-a33a-793d05ba83d0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.269786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.270691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.270976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.271253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.272553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.274023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.275804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 44/85] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.276572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.283709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.285211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.333579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.375771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94c56f-bbf5-4e06-acd1-fdf83f3b4900 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.392972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 42/86] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:43:56.393857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.414038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.414942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.415225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.415489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.416697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.418163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.419956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 45/87] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.420695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.421771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.497303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e974be-ae83-43a3-8c25-60bbb3732a60 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.525109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14517b-39c9-4990-a4a9-e6a549d44808 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.532492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.533191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.533471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.533746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.534550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:56.534857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.536207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.544815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 43/88] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.545630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.551273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.561303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.561991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.562279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.562597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.563329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.564815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.590629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 46/89] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:43:56 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:43:56.591486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.642953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.659421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52900d3a-db1e-4d6e-8a3d-85c39c3df5bd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.697469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.698144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.698447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.698742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.699581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=7a11b13b53364a13a16a1b29e3946ed6) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:56.699896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.701465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.708680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 44/90] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/role_assignments?user.id=7a11b13b53364a13a16a1b29e3946ed6&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.709426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.728800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce7d4af-9aaf-4726-a186-33c9045ec75c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.777323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.778835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.779202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.779603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.781060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.782738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.784711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 47/91] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.785644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.851594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.856028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e553b33-ac9b-44b4-a5ae-e4c640f0ed7e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.904221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.904905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.905195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.905472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.906443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=94b99e0fd4694c7c9aaebeb2b195eb30) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:56.906860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.908376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.914910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 45/92] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/role_assignments?user.id=94b99e0fd4694c7c9aaebeb2b195eb30&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.916226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:56.916330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc1d4b-ef10-464c-8d6e-d13afd854331 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:56.940586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:56.968413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:56.969572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:56.969885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:56.971119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:56.972381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:56.973879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:56.975593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 48/93] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:56.983532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:57.057469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92812000-45fc-4d34-bfed-47f3b485db85 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:57.100841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:57.101532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:57.101826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:57.102117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:57.103323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] RBAC: Adding query filter params (role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=94b99e0fd4694c7c9aaebeb2b195eb30) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:57.103649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:57.105478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:57.113415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 46/94] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/role_assignments?user.id=94b99e0fd4694c7c9aaebeb2b195eb30&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=8835b245e6e44fbb929afd739098a927 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:57.129930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d7f62-16e8-4323-93e3-4e7bd41b9625 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:57.152990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:57.173946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:57.175042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:57.175524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:57.175995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:57.269457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:57.271319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:57.406218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 49/95] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:43:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:43:57.412285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:57.519819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:57.541504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad747eb5-5039-44bb-9db2-61351675c20b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:57.577872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd6252-8a70-4d0c-8359-a4620d57e246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:57.578781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6252-8a70-4d0c-8359-a4620d57e246 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:57.579067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6252-8a70-4d0c-8359-a4620d57e246 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:57.579346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd6252-8a70-4d0c-8359-a4620d57e246 None admin] PATH_INFO: `/v3/projects/8810d50151884742805596d23eba968d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:57.580554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6252-8a70-4d0c-8359-a4620d57e246 None admin] RBAC: Authorizing `identity:get_project(project_id=8810d50151884742805596d23eba968d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:57.582017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd6252-8a70-4d0c-8359-a4620d57e246 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:57.583773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 47/96] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:43:57 2022] GET /identity/v3/projects/8810d50151884742805596d23eba968d => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:57.589612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:57.613500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:57.694485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b469c47-b87e-44ff-9f73-00ef4c7afff1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:57.730189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:57.730974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:57.731182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:57.731508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:57.732367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=8810d50151884742805596d23eba968d, user.id=94b99e0fd4694c7c9aaebeb2b195eb30) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:57.732678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:57.734150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8042693-6873-406a-a61d-0eed76454f76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:57.740353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 50/97] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:43:57 2022] GET /identity/v3/role_assignments?user.id=94b99e0fd4694c7c9aaebeb2b195eb30&scope.project.id=8810d50151884742805596d23eba968d&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:59.187125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae36ab-678b-474a-9933-ac98dc169283 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.187652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae36ab-678b-474a-9933-ac98dc169283 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.187652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae36ab-678b-474a-9933-ac98dc169283 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.189242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 48/98] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:59.194373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.194840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.195014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.212344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:59.213556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:59.283460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 51/99] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:43:59.305407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae36ab-678b-474a-9933-ac98dc169283 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:59.441164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae36ab-678b-474a-9933-ac98dc169283 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:59.478264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976300a7-48c0-4256-8962-06eefa277979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:59.479101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976300a7-48c0-4256-8962-06eefa277979 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.479380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976300a7-48c0-4256-8962-06eefa277979 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.479656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976300a7-48c0-4256-8962-06eefa277979 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.494700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976300a7-48c0-4256-8962-06eefa277979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-976300a7-48c0-4256-8962-06eefa277979 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:59.502617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:59.503477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:59.504242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 49/100] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:43:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:43:59.510996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:59.528152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:59.616372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b548f-ef69-41cb-b41b-d3679ce895bd None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.616707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b548f-ef69-41cb-b41b-d3679ce895bd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.616948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b548f-ef69-41cb-b41b-d3679ce895bd None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.618345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 50/101] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:43:59.623659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.624356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.624745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.644631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:43:59.646120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:43:59.648867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:59.665182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690cc973-b003-45c1-992a-d0979a03cc09 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:59.713818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:59.714758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.715210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.715652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.716606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:43:59.717112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:59.718674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:59.727512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 52/102] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:59.731650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 51/103] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:43:59.734035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:59.757714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:59.874186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:59.904573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0d84a0-3386-423d-ae2e-f14b7a835742 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:59.908024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb7ee3a-bfb8-49d1-8492-d805ff179b35 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:43:59.942701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d830216e-fa78-4eb0-bc27-e1bec1fd74b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:59.943876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02795c0-d1a9-42b2-8815-4b04e71060a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:43:59.944180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830216e-fa78-4eb0-bc27-e1bec1fd74b9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.944688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02795c0-d1a9-42b2-8815-4b04e71060a6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.944791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830216e-fa78-4eb0-bc27-e1bec1fd74b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.944970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02795c0-d1a9-42b2-8815-4b04e71060a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.945255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02795c0-d1a9-42b2-8815-4b04e71060a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.945624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d830216e-fa78-4eb0-bc27-e1bec1fd74b9 None admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.947168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830216e-fa78-4eb0-bc27-e1bec1fd74b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:43:59.948931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d830216e-fa78-4eb0-bc27-e1bec1fd74b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:43:59.950859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 53/104] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:43:59 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:43:59.952391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e2d32-9fa3-49af-ac62-088c0f341c3d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.953083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:43:59.954032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e2d32-9fa3-49af-ac62-088c0f341c3d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.954649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02e2d32-9fa3-49af-ac62-088c0f341c3d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:43:59.956135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 54/105] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:43:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:43:59.960434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e2d32-9fa3-49af-ac62-088c0f341c3d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:43:59.968122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02795c0-d1a9-42b2-8815-4b04e71060a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e02795c0-d1a9-42b2-8815-4b04e71060a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:43:59.983202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:43:59.984080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:43:59.984858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 52/106] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:43:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:43:59.985978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:43:59.986068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:43:59.986497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.021799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:00.023021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:00.139095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02e2d32-9fa3-49af-ac62-088c0f341c3d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.161737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 53/107] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:43:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:00.162632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:00.193994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.194904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.195425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.195425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.203480 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.205006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.208087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 55/108] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:43:59 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:00.209110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:00.238004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:00.336822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b45c69-c5b0-41df-b83d-0302635f3afc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.406783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:00.417598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40862b8e-faa3-4678-8f45-a9878481b642 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.421969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.422689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.422975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.423254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.424028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:00.424342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.425750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.439587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 54/109] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:00.440673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:00.495231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.495968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.496251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.496529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.498151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.499649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.501721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 56/110] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:00.502535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:00.547068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87417cfa-3b86-4233-80a0-542e0969f7cb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.583782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.585019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.585449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.585867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/7a11b13b53364a13a16a1b29e3946ed6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.588286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407, user_id=7a11b13b53364a13a16a1b29e3946ed6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.589894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.605324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:00.610828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 55/111] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:00 2022] PUT /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/7a11b13b53364a13a16a1b29e3946ed6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:00.611799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:00.644190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fafa7a-6bc9-43d8-a8de-206b8fc3e262 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.684267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:00.687758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999661d4-86c8-43d0-ae86-0a3708c2b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.688983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999661d4-86c8-43d0-ae86-0a3708c2b021 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.689421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999661d4-86c8-43d0-ae86-0a3708c2b021 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.689872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999661d4-86c8-43d0-ae86-0a3708c2b021 None admin] PATH_INFO: `/v3/users/ad3580c9e4554dcc8354a0f7e616dc01` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.709344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999661d4-86c8-43d0-ae86-0a3708c2b021 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3580c9e4554dcc8354a0f7e616dc01)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.711596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999661d4-86c8-43d0-ae86-0a3708c2b021 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.713858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 57/112] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:00 2022] GET /identity/v3/users/ad3580c9e4554dcc8354a0f7e616dc01 => generated 289 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:00.715456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea21eb-3ddd-4269-bf87-6fb9763e5c40 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.716316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea21eb-3ddd-4269-bf87-6fb9763e5c40 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.716795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea21eb-3ddd-4269-bf87-6fb9763e5c40 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.718446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 58/113] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:00.720228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1f7f-eddb-46e3-8062-ae87346faf0e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.720753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1f7f-eddb-46e3-8062-ae87346faf0e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.721225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc1f7f-eddb-46e3-8062-ae87346faf0e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.723017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 59/114] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:00.723980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1f7f-eddb-46e3-8062-ae87346faf0e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:00.766798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cf3a2-6b2b-4a89-a812-245cbee81a52 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.806033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d99e29e-d419-475c-9187-890448e8f773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.806740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e29e-d419-475c-9187-890448e8f773 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.807034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e29e-d419-475c-9187-890448e8f773 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.807322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d99e29e-d419-475c-9187-890448e8f773 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.808044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99e29e-d419-475c-9187-890448e8f773 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.809593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d99e29e-d419-475c-9187-890448e8f773 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.836808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 56/115] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:44:00 2022] POST /identity/v3/projects => generated 302 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:00.843865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58071-af91-438f-8909-c2d3ffe75ee9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.844071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc1f7f-eddb-46e3-8062-ae87346faf0e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:00.844153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58071-af91-438f-8909-c2d3ffe75ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.844430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c58071-af91-438f-8909-c2d3ffe75ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.877679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-31c58071-af91-438f-8909-c2d3ffe75ee9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:00.880112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-31c58071-af91-438f-8909-c2d3ffe75ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:00.889207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c81fb-6d8b-4e6b-8c75-f234df3ae4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:00.889881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c81fb-6d8b-4e6b-8c75-f234df3ae4bf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.890175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c81fb-6d8b-4e6b-8c75-f234df3ae4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.890498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c81fb-6d8b-4e6b-8c75-f234df3ae4bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:00.895614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:00.971854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c81fb-6d8b-4e6b-8c75-f234df3ae4bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:00.973378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c81fb-6d8b-4e6b-8c75-f234df3ae4bf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:00.985091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 57/116] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:00.987428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a814e-9fc7-4a2f-9b4c-0ee183088a51 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:00.987938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a814e-9fc7-4a2f-9b4c-0ee183088a51 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:00.988446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a814e-9fc7-4a2f-9b4c-0ee183088a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.007683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-271a814e-9fc7-4a2f-9b4c-0ee183088a51 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:01.009199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-271a814e-9fc7-4a2f-9b4c-0ee183088a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:01.038315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.092716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 58/117] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:01.094670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b2f4e-a8ec-491b-b66e-055a3c15cb23 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.095500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b2f4e-a8ec-491b-b66e-055a3c15cb23 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.095911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b2f4e-a8ec-491b-b66e-055a3c15cb23 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.097332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 59/118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:01.098738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b2f4e-a8ec-491b-b66e-055a3c15cb23 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.111745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 60/119] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:01.112902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.113180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.113459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.135108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:01.136290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:01.166557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.205850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 61/120] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:01.206562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.229796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b2f4e-a8ec-491b-b66e-055a3c15cb23 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.280655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.281967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.282602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.282894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.297817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:01.308633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:01.309822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:01.310625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 60/121] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:01.311439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.323475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8379f1-a795-4bef-9572-4daf3de6e4a6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.344098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.359977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.360938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.361286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.361626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.365470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:01.365470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:01.368851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 62/122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:01.368851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.409969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.435630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99562b71-88a1-4a50-b5f1-df6d0ba771b5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.474369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.475231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.475626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.475914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.479034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17296d73-1257-4da9-b47f-0b049ca3e7bb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.487759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:01.496031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:01.496948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:01.497726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 61/123] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:01.498366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.515565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.516472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.516756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.517027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.527899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:01.536532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:01.537423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:01.538211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 63/124] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:01.539464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.589003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.610745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64c1e15-1323-4a90-b34d-8f77ea8f350a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.648329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.649101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.649487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.649776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.650575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:01.650891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:01.652294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:01.661283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.662913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 62/125] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:01.668485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.669023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d5d3d-2685-44e2-a864-5d468411ffde None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.704456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.705256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.705600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.705980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.706911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] RBAC: Adding query filter params (role.id=c93d9de09c0241e0afc667b948525e47, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=ad3580c9e4554dcc8354a0f7e616dc01) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:01.707287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:01.708823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:01.714822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 64/126] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/role_assignments?user.id=ad3580c9e4554dcc8354a0f7e616dc01&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=c93d9de09c0241e0afc667b948525e47 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:01.723416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.783967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cd95c-341d-4af7-8333-51d51ce8a09f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.844870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.845475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.845862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.846156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.847093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:01.847412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:01.848851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:01.858980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 63/127] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:01.859771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.870699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:01.883613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd627c9-a430-48b2-96d8-af72fb7e40c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:01.920386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:01.921283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:01.921649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:01.922020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:01.922870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:01.923369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:01.925682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:01.939242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 65/128] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:01.940650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:01.997331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de8851-0838-44fc-898f-e8e8c1cf2859 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.002548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:02.038502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.039413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.039703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.039986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.041411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.042915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.044856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 64/129] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:02.045730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.133024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:02.134550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896c1b6-cbc1-49a5-ad16-d42c886d2df7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.162133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab661dd-9384-4fca-a904-a52c04efe4d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.195710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.195998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.196274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.198736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.199623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.199915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.200239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.201452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.202950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.203126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.204580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.204684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 65/130] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:02 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:02.205413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.206221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 66/131] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:01 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:02.214615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.330786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36215828-3892-4504-a7e6-fb4e63304421 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.384619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:02.386269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.387414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.387751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.390959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] PATH_INFO: `/v3/projects/8810d50151884742805596d23eba968d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.392284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=8810d50151884742805596d23eba968d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.393754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.395528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 66/132] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:02 2022] GET /identity/v3/projects/8810d50151884742805596d23eba968d => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:02.396315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.400571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33a16d9-c7f4-4905-8094-26bd1e65a561 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.420625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:02.441864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.443235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.443723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.444205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.445593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.447557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.449696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 67/133] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:02 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:02.450784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.569015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98565917-3023-42a5-a64e-36198f444ec9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.597228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cca37a-1a80-4f81-a432-9878c4d62d3c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.607055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.608361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.608854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.609356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.610930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.612724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.614802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 67/134] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:02 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:02.615867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.643725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.644564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.644982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.645262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] PATH_INFO: `/v3/projects/8810d50151884742805596d23eba968d/users/94b99e0fd4694c7c9aaebeb2b195eb30/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.652038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] RBAC: Authorizing `identity:create_grant(project_id=8810d50151884742805596d23eba968d, user_id=94b99e0fd4694c7c9aaebeb2b195eb30, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.653540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.688910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 68/135] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:02 2022] PUT /identity/v3/projects/8810d50151884742805596d23eba968d/users/94b99e0fd4694c7c9aaebeb2b195eb30/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:02.689542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:02.709403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:02.721657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:02.739219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f7b09-5e33-4ab4-996d-8740cdf620ee None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.778345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b93dc5-18f2-4562-8897-c1f79b6b328e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.779874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b93dc5-18f2-4562-8897-c1f79b6b328e None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.780399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b93dc5-18f2-4562-8897-c1f79b6b328e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.780887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b93dc5-18f2-4562-8897-c1f79b6b328e None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/94b99e0fd4694c7c9aaebeb2b195eb30/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.783298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b93dc5-18f2-4562-8897-c1f79b6b328e None admin] RBAC: Authorizing `identity:create_grant(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407, user_id=94b99e0fd4694c7c9aaebeb2b195eb30, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.785044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b93dc5-18f2-4562-8897-c1f79b6b328e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.803012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 68/136] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:02 2022] PUT /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/94b99e0fd4694c7c9aaebeb2b195eb30/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:02.852943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f026a-d918-4968-a139-38b0f797a158 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:02.894845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f349e6-a594-4b4a-ba7b-706a6c3a13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:02.896313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f349e6-a594-4b4a-ba7b-706a6c3a13c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:02.896818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f349e6-a594-4b4a-ba7b-706a6c3a13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:02.897296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f349e6-a594-4b4a-ba7b-706a6c3a13c9 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/94b99e0fd4694c7c9aaebeb2b195eb30/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:02.900238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f349e6-a594-4b4a-ba7b-706a6c3a13c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407, user_id=94b99e0fd4694c7c9aaebeb2b195eb30, role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:02.902186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f349e6-a594-4b4a-ba7b-706a6c3a13c9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:02.919811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 69/137] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:02 2022] PUT /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/94b99e0fd4694c7c9aaebeb2b195eb30/roles/8835b245e6e44fbb929afd739098a927 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:03.064680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a23d-5857-43f2-bf6c-0a3368450532 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.065359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a23d-5857-43f2-bf6c-0a3368450532 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.065842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868a23d-5857-43f2-bf6c-0a3368450532 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.067704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 69/138] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:03.073979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77493-c383-4efa-affe-d734dbd54be4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.074650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77493-c383-4efa-affe-d734dbd54be4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.075162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec77493-c383-4efa-affe-d734dbd54be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.094493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0ec77493-c383-4efa-affe-d734dbd54be4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:03.096174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0ec77493-c383-4efa-affe-d734dbd54be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:03.177941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 70/139] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:03.180210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90f6cf-0662-4802-9835-55fc2d820b3f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.180719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90f6cf-0662-4802-9835-55fc2d820b3f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.181221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa90f6cf-0662-4802-9835-55fc2d820b3f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.182869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 70/140] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:03.188637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.188953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.189227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.204429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:03.208372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90f6cf-0662-4802-9835-55fc2d820b3f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:03.212846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:03.215051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:03.303943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 71/141] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:03.341020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:03.342237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa90f6cf-0662-4802-9835-55fc2d820b3f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:03.402251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:03.404189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.404687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.405181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.411059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:03.413146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:03.415307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 71/142] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:03.420905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:03.432558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:03.553546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0dcfb-ed0f-40d1-8214-b62c1aaf733e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:03.589086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:03.589952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.590242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.590589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.598734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:03.602671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:03.611043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:03.612012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:03.612801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 72/143] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:03.620248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:03.623378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3e7c70-cac7-44e5-b4a7-160b163cb474 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:03.711539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:03.712238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.712526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.712804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.713531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:03.715037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:03.769039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 72/144] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:03 2022] POST /identity/v3/users => generated 283 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:44:03.790318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ace389-df5c-474c-a178-57b0237955d3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:03.833531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:03.834216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:03.834529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:03.834809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:03.835577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:03.835883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:03.837280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:03.847341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 73/145] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:03.852850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:03.932321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:03.981742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af045de9-4223-4dc5-9269-19a4f25d32c3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:04.030671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:04.031575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.031876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.032155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] PATH_INFO: `/v3/users/7a11b13b53364a13a16a1b29e3946ed6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.033383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] RBAC: Authorizing `identity:get_user(user_id=7a11b13b53364a13a16a1b29e3946ed6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:04.034883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:04.036702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 73/146] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:03 2022] GET /identity/v3/users/7a11b13b53364a13a16a1b29e3946ed6 => generated 247 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:04.042127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:04.124333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:04.178398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed1d6a-8a2f-4228-b98f-c547d946f68f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:04.224243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc78383-f90a-4816-b377-7c71b5b7112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:04.224882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc78383-f90a-4816-b377-7c71b5b7112c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.225170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc78383-f90a-4816-b377-7c71b5b7112c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.225451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc78383-f90a-4816-b377-7c71b5b7112c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.308968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc78383-f90a-4816-b377-7c71b5b7112c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:04.310812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc78383-f90a-4816-b377-7c71b5b7112c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:04.406789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:04.446941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 74/147] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:04.452617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:04.600006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaae08-8fbc-4d06-a974-926b127a0572 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.600246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaae08-8fbc-4d06-a974-926b127a0572 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.600484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaae08-8fbc-4d06-a974-926b127a0572 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.602262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 75/148] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:04.607892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.608191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.608453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.608557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79369491-aff5-4b72-a2ff-d5e6113e53d7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:04.631555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:04.632736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:04.657883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:04.668171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:04.669212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.669501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.669785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.671098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:04.672562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:04.674385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 74/149] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:04 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:04.680193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:04.726724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 76/150] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:04.750093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:04.851378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:04.861048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b254c2a-26a5-41dd-a740-ed1177022c8a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:04.898973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:04.899774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.900054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.900431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.914136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:04.923964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:04.924843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:04.925603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 77/151] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:04.931224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:04.938881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b21b-30db-4853-abc2-d44d8399aaca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:04.992320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:04.993004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:04.993291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:04.993575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:04.994444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=7a11b13b53364a13a16a1b29e3946ed6) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:04.994762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:04.996208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:05.016073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 75/152] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:04 2022] GET /identity/v3/role_assignments?user.id=7a11b13b53364a13a16a1b29e3946ed6&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:05.044220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e08ebc8-17eb-4047-816d-8a1d7f81fff2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:05.080893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:05.081587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:05.081871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:05.082146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:05.082949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:05.083256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:05.084696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:05.095557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 78/153] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:05.100709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:05.183065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:05.231854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba00bd-7c78-4d5b-8ce0-5411899883e3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:05.270718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:05.271619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:05.271905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:05.272182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] PATH_INFO: `/v3/users/ad3580c9e4554dcc8354a0f7e616dc01` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:05.273427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] RBAC: Authorizing `identity:get_user(user_id=ad3580c9e4554dcc8354a0f7e616dc01)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:05.274956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:05.276670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 76/154] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:05 2022] GET /identity/v3/users/ad3580c9e4554dcc8354a0f7e616dc01 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:05.282443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:05.310861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:05.435117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a0f59-bddb-4ded-a5d7-8fbc92f91bdb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:05.478496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae24c05-ebad-4cff-be88-243c5dec4ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:05.479374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24c05-ebad-4cff-be88-243c5dec4ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:05.479696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24c05-ebad-4cff-be88-243c5dec4ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:05.479925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae24c05-ebad-4cff-be88-243c5dec4ea0 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:05.481139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24c05-ebad-4cff-be88-243c5dec4ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:05.482955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae24c05-ebad-4cff-be88-243c5dec4ea0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:05.485039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 79/155] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:05 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:05.490286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:05.628925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8fe32-97ce-4664-8629-0953c285f941 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:05.664569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:05.674951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ad7fd3-920b-42ad-b2d9-ba8a8e025efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:05.675867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fd3-920b-42ad-b2d9-ba8a8e025efa None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:05.676153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fd3-920b-42ad-b2d9-ba8a8e025efa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:05.676437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ad7fd3-920b-42ad-b2d9-ba8a8e025efa None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/ad3580c9e4554dcc8354a0f7e616dc01/roles/c93d9de09c0241e0afc667b948525e47` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:05.678459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7fd3-920b-42ad-b2d9-ba8a8e025efa None admin] RBAC: Authorizing `identity:create_grant(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407, user_id=ad3580c9e4554dcc8354a0f7e616dc01, role_id=c93d9de09c0241e0afc667b948525e47)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:05.679932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ad7fd3-920b-42ad-b2d9-ba8a8e025efa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:05.706020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 77/156] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:05 2022] PUT /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/users/ad3580c9e4554dcc8354a0f7e616dc01/roles/c93d9de09c0241e0afc667b948525e47 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:05.875866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05af7-9557-4c3a-8dd3-252ae9358855 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:05.876591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05af7-9557-4c3a-8dd3-252ae9358855 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:05.877078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05af7-9557-4c3a-8dd3-252ae9358855 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:05.879100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 80/157] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:05.885215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:05.885995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:05.886593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:05.911738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:05.913330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:06.002289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 78/158] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:06.041082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05af7-9557-4c3a-8dd3-252ae9358855 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:06.131890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:06.164062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05af7-9557-4c3a-8dd3-252ae9358855 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:06.209879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dd907-03e4-4301-925f-8bffaab67030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:06.210742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dd907-03e4-4301-925f-8bffaab67030 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.211025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dd907-03e4-4301-925f-8bffaab67030 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.211303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dd907-03e4-4301-925f-8bffaab67030 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.222691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dd907-03e4-4301-925f-8bffaab67030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dc5dd907-03e4-4301-925f-8bffaab67030 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:06.230728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:06.232136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:06.232917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:06.236863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 81/159] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:06.239912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:06.309298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee209ef-0961-4441-91a5-3e386701814d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.310108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee209ef-0961-4441-91a5-3e386701814d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.310577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee209ef-0961-4441-91a5-3e386701814d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.317303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 82/160] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:06.321468 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.321984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.322481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.350621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:06.352179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:06.385509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57aeef0-8ec4-412a-893f-5ce1511ef49b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:06.425151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:06.457443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:06.458127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.458405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.458702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.459451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:06.459808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:06.461245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:06.476694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 83/161] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:06.479483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 79/162] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:06.485377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:06.509874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:06.642082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:06.730372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ca5fb4-e47a-42a2-ba5c-61a6caa563ad None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:06.780554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35549e6-9e29-4b76-8729-e95fb8d4c244 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:06.797754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:06.798986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.799418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.799939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.803005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:06.804706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:06.806548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 84/163] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:06 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:06.812242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:06.860023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc7621-de80-488c-b7aa-6aacfb44a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:06.860838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7621-de80-488c-b7aa-6aacfb44a64f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.861122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7621-de80-488c-b7aa-6aacfb44a64f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.861405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc7621-de80-488c-b7aa-6aacfb44a64f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.895369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc7621-de80-488c-b7aa-6aacfb44a64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-52fc7621-de80-488c-b7aa-6aacfb44a64f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:06.903170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:06.904201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:06.904977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:06.914564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 80/164] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:06.916133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb402c-1d73-4e95-8fd7-18621c8f5b80 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:06.916424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb402c-1d73-4e95-8fd7-18621c8f5b80 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:06.916732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb402c-1d73-4e95-8fd7-18621c8f5b80 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:06.918109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 81/165] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:06.918911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb402c-1d73-4e95-8fd7-18621c8f5b80 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:06.991050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:07.007629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ec4fb-491f-4ace-b991-2b8c5583483b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:07.096675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:07.097626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:07.098041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:07.098492 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:07.104005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:07.121291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb402c-1d73-4e95-8fd7-18621c8f5b80 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:07.211155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:07.212022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:07.212137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:07.212396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:07.213160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:07.213466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:07.214912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcd404-9a40-4add-84fe-0fe66ae36b29 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:07.223311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:07.224929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:07.237455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 82/166] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:07.238889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:07.239176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:07.239452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:07.275514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:07.276721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:07.420998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 85/167] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 09:44:07.421869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:07.465746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:07.488175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 83/168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:07.489077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:07.574535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f184d4-3ad0-4fdf-9921-4736d92bca31 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:07.605065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:07.640128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:07.641172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:07.641463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:07.641744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:07.647406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:07.649075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:07.650968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 86/169] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:07 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:07.651921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:07.785306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafedc-9a4f-4091-a4ed-b02005b961b3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:07.808810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3ea22-4b03-4559-b381-d8a746c77b47 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:07.816543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:07.874893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:07.875775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:07.876058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:07.876337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:07.877577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:07.878438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:07.878730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:07.878999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:07.880307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:07.881774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:07.883533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 84/170] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:07 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:07.884381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:07.911402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:07.919263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:07.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:07.920912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 87/171] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:07.921632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:08.074331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28b2ce-db50-4e17-99f2-33144beee624 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:08.123280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4f64df-9a6b-4726-887d-89c85a372aff None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:08.125529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:08.136123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:08.136804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.137208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.137490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.138801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] RBAC: Adding query filter params (role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=94b99e0fd4694c7c9aaebeb2b195eb30) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:08.139114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:08.140620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:08.155214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 88/172] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:07 2022] GET /identity/v3/role_assignments?user.id=94b99e0fd4694c7c9aaebeb2b195eb30&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=8835b245e6e44fbb929afd739098a927 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:08.155904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:08.200736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef3e725-6a6b-475f-a6ff-b8b89ea63569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:08.201821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3e725-6a6b-475f-a6ff-b8b89ea63569 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.202316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3e725-6a6b-475f-a6ff-b8b89ea63569 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.202803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef3e725-6a6b-475f-a6ff-b8b89ea63569 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.227365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:08.344807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3e725-6a6b-475f-a6ff-b8b89ea63569 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:08.346644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef3e725-6a6b-475f-a6ff-b8b89ea63569 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:08.368009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03e070-79ba-479c-abc5-54f9fcfa8a3f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:08.409622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:08.410305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.410619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.410898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.411661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:08.411970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:08.413380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a81de-7b56-45af-add3-f6a9555b2759 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:08.430231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 89/173] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:08.431641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec72a9a-daf2-41dd-a0a3-24660ae64fed None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.431930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec72a9a-daf2-41dd-a0a3-24660ae64fed None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.432207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec72a9a-daf2-41dd-a0a3-24660ae64fed None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.433465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 90/174] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:08.436678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec72a9a-daf2-41dd-a0a3-24660ae64fed None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:08.541919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 85/175] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:08.543385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4bca5-62f2-4571-ae80-04137df79a59 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.544024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4bca5-62f2-4571-ae80-04137df79a59 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.544439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4bca5-62f2-4571-ae80-04137df79a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.550376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:08.563704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c2e4bca5-62f2-4571-ae80-04137df79a59 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:08.564917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2e4bca5-62f2-4571-ae80-04137df79a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:08.594494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:08.609051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec72a9a-daf2-41dd-a0a3-24660ae64fed None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:08.651615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 86/176] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:08.653178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:08.654127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.654428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.654717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] PATH_INFO: `/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.655993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] RBAC: Authorizing `identity:get_user(user_id=94b99e0fd4694c7c9aaebeb2b195eb30)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:08.657444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:08.659092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd783d2-4a84-4313-ba2b-8a7eabb96f5c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.659217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 91/177] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:08 2022] GET /identity/v3/users/94b99e0fd4694c7c9aaebeb2b195eb30 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:08.659698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd783d2-4a84-4313-ba2b-8a7eabb96f5c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.660168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd783d2-4a84-4313-ba2b-8a7eabb96f5c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.661733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 87/178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:08.663019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07120b-3250-40ce-9e78-9cb0b719d69e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.664156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07120b-3250-40ce-9e78-9cb0b719d69e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.664371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:08.668791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de07120b-3250-40ce-9e78-9cb0b719d69e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.670383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 88/179] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:08.671447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07120b-3250-40ce-9e78-9cb0b719d69e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:08.776014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b3a199-fbf0-4948-a6d6-5b7b81b42625 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:08.780324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de07120b-3250-40ce-9e78-9cb0b719d69e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:08.809522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfdadfa-4cfa-40cf-a9e0-c6660678fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:08.809908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:08.810350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdadfa-4cfa-40cf-a9e0-c6660678fe4d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.810651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdadfa-4cfa-40cf-a9e0-c6660678fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.810921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfdadfa-4cfa-40cf-a9e0-c6660678fe4d None admin] PATH_INFO: `/v3/projects/8810d50151884742805596d23eba968d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.812165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdadfa-4cfa-40cf-a9e0-c6660678fe4d None admin] RBAC: Authorizing `identity:get_project(project_id=8810d50151884742805596d23eba968d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:08.813777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfdadfa-4cfa-40cf-a9e0-c6660678fe4d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:08.815530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 92/180] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:08 2022] GET /identity/v3/projects/8810d50151884742805596d23eba968d => generated 312 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:08.815898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390796b6-3eff-48d3-a4aa-ee5d2369589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:08.816562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390796b6-3eff-48d3-a4aa-ee5d2369589a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.816840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390796b6-3eff-48d3-a4aa-ee5d2369589a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.817115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390796b6-3eff-48d3-a4aa-ee5d2369589a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.821431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6e808-d04c-4b48-914e-ee85398ae8f3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.821718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6e808-d04c-4b48-914e-ee85398ae8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.821990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6e808-d04c-4b48-914e-ee85398ae8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.837945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bbd6e808-d04c-4b48-914e-ee85398ae8f3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:08.839137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bbd6e808-d04c-4b48-914e-ee85398ae8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:08.861204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:08.895338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390796b6-3eff-48d3-a4aa-ee5d2369589a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:08.896821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390796b6-3eff-48d3-a4aa-ee5d2369589a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:08.909016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 93/181] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:08.910294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:08.910616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:08.910854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:08.932921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:08.934065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:09.007271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 94/182] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:09.008125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.008230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 89/183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:09.009559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804c07-4500-46e3-a3db-1bdd00cace9f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.009847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804c07-4500-46e3-a3db-1bdd00cace9f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.010121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4804c07-4500-46e3-a3db-1bdd00cace9f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.011392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 90/184] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:09.018996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804c07-4500-46e3-a3db-1bdd00cace9f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.051504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.100563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.116164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137eac4-9a49-4d98-aa0c-8c4b647b5e74 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.121099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4804c07-4500-46e3-a3db-1bdd00cace9f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.150041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba61ff-1114-4de0-8231-d2ba15901bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.150852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba61ff-1114-4de0-8231-d2ba15901bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.151128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba61ff-1114-4de0-8231-d2ba15901bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.151400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba61ff-1114-4de0-8231-d2ba15901bc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.155259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.155910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.156187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.156467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.157297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=8810d50151884742805596d23eba968d, user.id=94b99e0fd4694c7c9aaebeb2b195eb30) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:09.157602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.159086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.161575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba61ff-1114-4de0-8231-d2ba15901bc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:09.164900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 91/185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/role_assignments?user.id=94b99e0fd4694c7c9aaebeb2b195eb30&scope.project.id=8810d50151884742805596d23eba968d&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:09.165676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-69ba61ff-1114-4de0-8231-d2ba15901bc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:09.169581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:09.170700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:09.171735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 95/186] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:09.172548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.172965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.173064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.197995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:09.199272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:09.278554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 96/187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:09.278554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.291103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.299372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2df026-338f-4ec9-83fd-f90f2054db0d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.342444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.343609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.344048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.344328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.356068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:09.363779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:09.364718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:09.365598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 92/188] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:09.366306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.367827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.401743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152b058-3d46-4435-9eb4-b25ea74a6c03 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.434570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.435424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.435703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.435969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.437128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.438612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.440326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 97/189] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:09.441086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.470403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98486f8-b0b7-4b22-9b4c-7e2cef72a2d5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.503633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.504432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.504715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.504991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.506148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.507614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.509411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 93/190] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:09.509998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.536393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.541658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e2bdb-aa0a-4f7a-964d-f8c24102c01b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.575307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.575977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.576264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.576543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.577293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:09.577601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.579049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.587109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 98/191] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:09.587895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.597077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.616806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30335731-40a8-4679-b24d-eeb642b973d5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.651326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.652638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.653238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.653324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.663432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:09.671403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:09.672352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:09.673140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 94/192] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:09.678123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.688420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ad5d-2897-40b6-b7dc-60ac3b7ebe7c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.722248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.722943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.723225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.723488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.724239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:09.724541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.725939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.733997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 99/193] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:09.738721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.763733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.779845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed763f7-4635-481c-8309-73eaa2b15c71 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.804605 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:09.813334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.813994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.814280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.814590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.815424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=94b99e0fd4694c7c9aaebeb2b195eb30) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:09.815740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.817190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.823047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 95/194] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/role_assignments?user.id=94b99e0fd4694c7c9aaebeb2b195eb30&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:09.823830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.848967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7395671-36a7-4a74-b51d-a2061ae1748b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.890037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.890623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.890901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.891174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:09.891898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:09.893509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:09.916307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 100/195] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:09 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:09.927670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:09.950229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed81e2d-39fa-49ae-99d3-cd05f68ec517 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:09.993171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:09.994255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:09.994617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:09.994896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] PATH_INFO: `/v3/users/2ef004299aed4f82aff535e3ae7255cb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.011938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] RBAC: Authorizing `identity:get_user(user_id=2ef004299aed4f82aff535e3ae7255cb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.013960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.020726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 96/196] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/users/2ef004299aed4f82aff535e3ae7255cb => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:10.021734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.031670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.076994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699fabe-3a0d-440f-99c3-f1a44240dfc2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.107847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.124560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.125464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.125883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.127427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.128359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:10.128670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.132503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.139432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 101/197] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:10.140433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.159707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0067f12a-5bdc-4065-a37c-e10524a20d8b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.210601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.211306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.211585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.211855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] PATH_INFO: `/v3/users/2ef004299aed4f82aff535e3ae7255cb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.213366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] RBAC: Authorizing `identity:get_user(user_id=2ef004299aed4f82aff535e3ae7255cb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.214865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.217091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 97/198] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/users/2ef004299aed4f82aff535e3ae7255cb => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:10.217880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.270930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2befb43-aaba-41ce-974e-d8dfc9879493 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.308496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.319664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.320895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.321339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.321750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.336131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da7d45-fcfb-4b12-aed8-7291c5d14237 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.380920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.381954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.382248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.382618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] PATH_INFO: `/v3/users/ad3580c9e4554dcc8354a0f7e616dc01` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.383887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] RBAC: Authorizing `identity:get_user(user_id=ad3580c9e4554dcc8354a0f7e616dc01)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.385488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.387727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 98/199] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/users/ad3580c9e4554dcc8354a0f7e616dc01 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:10.389273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.397848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.417496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.419729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.509277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e5f3b-2519-41ac-a3f2-2b04090b1ebb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.535454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 102/200] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:10.536445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.556594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.557486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.557973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.558722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.573593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.634777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.636302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.646493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.670512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297b30b-2952-41b4-845a-412f29a4b7d9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.717229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.718064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.718351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.718669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.768584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 99/201] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:10.770600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.802393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.803936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.823425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.885461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78dee73-1c5b-462e-841a-492af0b3625c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:10.910223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:10.929191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:10.930001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:10.930284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:10.930606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:10.931803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:10.932649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 103/202] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:10.933594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:10.933891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:10.935425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 100/203] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:10.938963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:11.042996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb0cffc-d6e4-4bae-befb-cf33a084848a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:11.079698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e78d82-8cb8-4425-9fcc-c9cfee90f0c2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:11.080400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:11.081475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:11.081951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:11.082390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:11.083849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:11.085508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:11.087563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 104/204] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:11.088523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:11.091948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:11.124380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:11.125289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:11.125571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:11.125848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:11.127069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:11.128745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:11.130649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 101/205] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:10 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:11.131257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:11.161242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:11.229687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f98d5ab-bd4a-4ac7-83b3-bbc18b773a26 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:11.252466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb3fc6-e318-4ff2-a90f-ea82bcdf6e13 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:11.275085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:11.276356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:11.277135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:11.277984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:11.279931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=2ef004299aed4f82aff535e3ae7255cb) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:11.280778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:11.282831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:11.289798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 105/206] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:11 2022] GET /identity/v3/role_assignments?user.id=2ef004299aed4f82aff535e3ae7255cb&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:11.290993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:11.317392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:11.318913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:11.319405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:11.319899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:11.323482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] RBAC: Adding query filter params (role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=2ef004299aed4f82aff535e3ae7255cb) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:11.324496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:11.326948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575242cc-6792-41a1-baf8-040d33c9e41d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:11.344358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 102/207] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:11 2022] GET /identity/v3/role_assignments?user.id=2ef004299aed4f82aff535e3ae7255cb&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=8835b245e6e44fbb929afd739098a927 => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:11.468679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e92982-ecda-4cb7-903e-0fd2c0ad2813 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:11.493146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:11.516273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:11.517366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:11.517848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:11.518318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:11.519471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] RBAC: Adding query filter params (role.id=c93d9de09c0241e0afc667b948525e47, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407, user.id=ad3580c9e4554dcc8354a0f7e616dc01) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:11.520029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:11.521886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa6afc4-1f38-4793-a038-19ef6b5b92e7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:11.534218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 106/208] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:11 2022] GET /identity/v3/role_assignments?user.id=ad3580c9e4554dcc8354a0f7e616dc01&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=c93d9de09c0241e0afc667b948525e47 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:12.226425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b7fb8-707c-4348-90f3-d2d44f5dfd52 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.226425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b7fb8-707c-4348-90f3-d2d44f5dfd52 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.226425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3b7fb8-707c-4348-90f3-d2d44f5dfd52 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.226425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 103/209] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:12.228740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433f16-c581-47fd-9f83-d37aa7cae042 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.229111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433f16-c581-47fd-9f83-d37aa7cae042 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.229289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a433f16-c581-47fd-9f83-d37aa7cae042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.247110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8a433f16-c581-47fd-9f83-d37aa7cae042 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:12.248436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8a433f16-c581-47fd-9f83-d37aa7cae042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:12.323126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 107/210] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:12.345600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b7fb8-707c-4348-90f3-d2d44f5dfd52 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:12.352687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677004b-258c-4eb0-b301-ce543377c739 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.352981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677004b-258c-4eb0-b301-ce543377c739 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.353266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677004b-258c-4eb0-b301-ce543377c739 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.354965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 108/211] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:12.361567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.362111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.362399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.384336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:12.385535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:12.400389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:12.464154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3b7fb8-707c-4348-90f3-d2d44f5dfd52 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:12.472471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 109/212] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:12.497021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:12.503006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:12.503813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.504141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.504459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.516720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:12.524840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:12.526865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:12.528962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:12.531189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 104/213] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:12.538435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:12.542272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:12.600150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096f440-dfb4-4f03-b34d-30ffe1c19308 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:12.636461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:12.637510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.637880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.638600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.640019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:12.641473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:12.643532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 110/214] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:12.644550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ea19-9913-4d68-a4fb-3c988f5f5553 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:12.649913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:12.652388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:12.683005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:12.683689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.683967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.684379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.685340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:12.685649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:12.687217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:12.702717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 105/215] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:12.703821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:12.756047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce38e17-e345-4e98-899c-e5a139d9ce87 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:12.767495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:12.791779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:12.792606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.792990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.793384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.794261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:12.795840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:12.817966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ece569-fd49-45bb-80a1-24ec9a2587d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:12.826730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 111/216] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:12 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:44:12.857071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:12.857971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:12.858252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:12.858558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] PATH_INFO: `/v3/users/0eda1c2078b646648a114234b07f5c14` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:12.875099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] RBAC: Authorizing `identity:get_user(user_id=0eda1c2078b646648a114234b07f5c14)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:12.876594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:12.882930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 106/217] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:12 2022] GET /identity/v3/users/0eda1c2078b646648a114234b07f5c14 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:12.884690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:12.994545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfcf8f-c32b-4be5-848f-670ba4ae93cb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:13.029851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:13.030479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.030761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.031037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.067889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:13.107125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:13.108644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:13.216700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 112/218] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:13.222259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:13.249694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:13.339705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5fd0f6-2118-4f92-8b1e-6d146dbf5217 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:13.385506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1005ab1d-bbb2-4669-897e-8a9a7f3dc34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:13.386388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005ab1d-bbb2-4669-897e-8a9a7f3dc34f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.386691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005ab1d-bbb2-4669-897e-8a9a7f3dc34f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.386965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1005ab1d-bbb2-4669-897e-8a9a7f3dc34f None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.389374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005ab1d-bbb2-4669-897e-8a9a7f3dc34f None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:13.390929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1005ab1d-bbb2-4669-897e-8a9a7f3dc34f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:13.396181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 107/219] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:13 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:13.402580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:13.503666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:13.554214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05732a-9b26-4742-a35c-539d7f67d8ee None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:13.609541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:13.610134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.610492 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.610776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.611623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=0eda1c2078b646648a114234b07f5c14) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:13.611934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:13.613389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14525a4-fc4e-41d3-9112-09a956681537 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:13.623085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 113/220] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:13 2022] GET /identity/v3/role_assignments?user.id=0eda1c2078b646648a114234b07f5c14&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 259 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:13.680403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458564-34e4-453b-ae49-ce5fa4b88787 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.680743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458564-34e4-453b-ae49-ce5fa4b88787 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.680963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458564-34e4-453b-ae49-ce5fa4b88787 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.682567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 108/221] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:13.689051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c677f-8976-46e8-8700-17b80b545a46 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.689351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c677f-8976-46e8-8700-17b80b545a46 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.689604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c677f-8976-46e8-8700-17b80b545a46 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.691254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 109/222] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:44:13.692030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.692319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.692599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.696480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:13.696764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:13.697038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:13.724577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:13.725813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:13.733276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:13.734546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:13.855420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 114/223] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:13.856810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 110/224] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:13.877970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:13.886670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:13.935554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:13.947986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:13.992159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a5eef-f48d-4afa-9b3a-89b63310e60e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.030618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.031495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.031786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.032066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.043776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:14.053044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:14.054151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:14.054974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:14.058694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 115/225] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:14.061235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.144519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29529d3-d31d-4297-baf6-8f9a6ad10317 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.195042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922fe683-bbe7-4aab-8e3f-e6f8324ec28c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.223588 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:14.229443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.231448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.232029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.232348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.232957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.233448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.233845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.234201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.242928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:14.245338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:14.247120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:14.248072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:14.259678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:14.261148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:14.262161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 111/226] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:14.270531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.276118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 116/227] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:14.281359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.422626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:14.448433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada8e2e-797b-480b-bdf1-6b93892aca9a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.475523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef2415-2b4f-47c4-a6f3-58a7bffa6ae1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.510168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.511379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.511665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.511945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] PATH_INFO: `/v3/users/2ef004299aed4f82aff535e3ae7255cb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.513715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] RBAC: Authorizing `identity:get_user(user_id=2ef004299aed4f82aff535e3ae7255cb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:14.515216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:14.517082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 117/228] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:14 2022] GET /identity/v3/users/2ef004299aed4f82aff535e3ae7255cb => generated 283 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:14.517900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.518777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.519192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.519623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.520507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:14.520940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:14.526489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:14.536130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.536989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 112/229] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:14.547037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.638975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:14.710536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d692eb9-6327-4d67-97a0-5109b20adb98 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.733444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1823945-dae6-41d8-addc-5d1706e688d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:14.773472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.774794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.775272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.775736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] PATH_INFO: `/v3/users/2ef004299aed4f82aff535e3ae7255cb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.777449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] RBAC: Authorizing `identity:get_user(user_id=2ef004299aed4f82aff535e3ae7255cb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:14.779635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:14.781956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 113/230] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:14 2022] GET /identity/v3/users/2ef004299aed4f82aff535e3ae7255cb => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:14.787389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.789119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:14.789998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:14.790269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:14.794640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:14.796977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:14.800340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:14.805670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 118/231] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:14 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:14.812624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:14.813750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:14.989949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e7e45-33a3-4caa-b97b-47f9ed132275 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:15.017503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a05eb-22c8-472d-a301-b229ae743235 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:15.053479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:15.061743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:15.062994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.063488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.065468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.067914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:15.069585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:15.076568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 114/232] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:14 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:15.083523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:15.086088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f838371-c327-4dde-98a5-a61dd21760bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:15.087358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838371-c327-4dde-98a5-a61dd21760bc None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.087842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838371-c327-4dde-98a5-a61dd21760bc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.088339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f838371-c327-4dde-98a5-a61dd21760bc None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/2ef004299aed4f82aff535e3ae7255cb/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.091241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838371-c327-4dde-98a5-a61dd21760bc None admin] RBAC: Authorizing `identity:create_grant(project_id=45b6d7a4e16544b9afd17d4b531d1ac0, user_id=2ef004299aed4f82aff535e3ae7255cb, role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:15.093014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f838371-c327-4dde-98a5-a61dd21760bc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:15.115964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 119/233] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:14 2022] PUT /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/2ef004299aed4f82aff535e3ae7255cb/roles/8835b245e6e44fbb929afd739098a927 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:15.227065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:15.254865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc444ee-ace9-4ab9-a132-5d1c2e79e822 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:15.305945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:15.306894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.307178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.307454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/2ef004299aed4f82aff535e3ae7255cb/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.315189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] RBAC: Authorizing `identity:create_grant(project_id=45b6d7a4e16544b9afd17d4b531d1ac0, user_id=2ef004299aed4f82aff535e3ae7255cb, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:15.316688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:15.337215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba7659-194a-4e65-a028-53134484ef0a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.337568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba7659-194a-4e65-a028-53134484ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.337773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba7659-194a-4e65-a028-53134484ef0a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.344202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 120/234] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:44:15.348122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877e48-98a1-49ea-b26a-1fe1dce731c7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.348415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877e48-98a1-49ea-b26a-1fe1dce731c7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.348756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa877e48-98a1-49ea-b26a-1fe1dce731c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.353104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 115/235] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:15 2022] PUT /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/2ef004299aed4f82aff535e3ae7255cb/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:44:15.379718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fa877e48-98a1-49ea-b26a-1fe1dce731c7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:15.380995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa877e48-98a1-49ea-b26a-1fe1dce731c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:15.470117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 121/236] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:15.496854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:15.585787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243430f5-08ea-4b58-9cc1-774c03577df3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.586268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243430f5-08ea-4b58-9cc1-774c03577df3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.586268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243430f5-08ea-4b58-9cc1-774c03577df3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.587865 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 122/237] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:15.595888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.596169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.596443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.626444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04ee6-861b-4333-923b-93b6fe76dc34 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:15.639633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:15.640839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:15.665931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:15.667011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.667927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.668353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.676647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:15.682302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:15.691585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:15.692753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:15.693787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:15.696917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 116/238] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:15.704561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:15.824194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 123/239] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:15.827216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c95c98-5a93-4f44-b7e0-9cefab440152 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:15.866484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:15.867478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:15.867583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:15.868052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:15.868542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:15.869798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:15.870304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:15.872891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:15.883002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 117/240] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:15.891313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:15.942225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.026795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.057032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72b9df3-b6f0-4a70-b7f6-6a8ffc42f3fa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.091961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b38ecd-fae8-4d7d-827c-7614b6bc563e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.107683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e997e-b6ce-4ff7-a71b-653e577687e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.108753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e997e-b6ce-4ff7-a71b-653e577687e1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.109036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e997e-b6ce-4ff7-a71b-653e577687e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.109464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e997e-b6ce-4ff7-a71b-653e577687e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.111617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e997e-b6ce-4ff7-a71b-653e577687e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:16.114849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6e997e-b6ce-4ff7-a71b-653e577687e1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:16.116750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 124/241] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:16.118220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308c96-7fa3-4240-9205-8ee2d2369036 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.118532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308c96-7fa3-4240-9205-8ee2d2369036 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.118816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f308c96-7fa3-4240-9205-8ee2d2369036 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.120214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 125/242] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:16.122264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308c96-7fa3-4240-9205-8ee2d2369036 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:16.136370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263946f1-b384-478c-8c21-fb3f5f1b02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.137311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263946f1-b384-478c-8c21-fb3f5f1b02fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.137592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263946f1-b384-478c-8c21-fb3f5f1b02fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.137863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263946f1-b384-478c-8c21-fb3f5f1b02fd None admin] PATH_INFO: `/v3/users/5634ac56eeac45b9a1585318d87f2a43` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.152644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263946f1-b384-478c-8c21-fb3f5f1b02fd None admin] RBAC: Authorizing `identity:get_user(user_id=5634ac56eeac45b9a1585318d87f2a43)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:16.154862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263946f1-b384-478c-8c21-fb3f5f1b02fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:16.161408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 118/243] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:15 2022] GET /identity/v3/users/5634ac56eeac45b9a1585318d87f2a43 => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:16.162731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.163014 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.163288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.183397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:16.184967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:16.245093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f308c96-7fa3-4240-9205-8ee2d2369036 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.253897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.274685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 119/244] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:16.275547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:16.295209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.296025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.296305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.296580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.297342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:16.301517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:16.336163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.337814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 126/245] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:16 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:16.343449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:16.462900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1db2bf-44e7-45d9-a74d-94cb12a63e5f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.525364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481df571-8410-4420-92e6-99204ad6a136 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.547169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.548238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.548854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.549427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.565611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.566442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.566725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.567101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.578109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:16.586019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:16.587361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:16.588228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 127/246] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:16.599435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:16.630397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.645248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:16.646747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:16.702542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.749563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d12be-306e-470d-8f96-8d8257bcfc76 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.775286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 120/247] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:16.781249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:16.799543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.800415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.800767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.801109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.801955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:16.802307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:16.803954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:16.816103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 128/248] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:16.821587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:16.910761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70532612-bf93-43fa-aa7d-e0f056a69da6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.927626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:16.949378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5b643-1771-4964-b675-9acd343d23bd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:16.967050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:16.967933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:16.968218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:16.968495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:16.969711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:16.971173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:16.972897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 121/249] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:16 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:16.979385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:17.000820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:17.002185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:17.003491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.005032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.005032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] PATH_INFO: `/v3/users/0eda1c2078b646648a114234b07f5c14` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.006333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] RBAC: Authorizing `identity:get_user(user_id=0eda1c2078b646648a114234b07f5c14)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:17.008345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:17.011864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 129/250] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:16 2022] GET /identity/v3/users/0eda1c2078b646648a114234b07f5c14 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:17.018123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:17.110335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec991af-4e94-4d3b-b057-b3406daa0e3e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:17.151106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249900ed-ee66-492b-885d-c8bcbb371e08 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:17.153435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:17.154306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.155673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.156159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.157179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] RBAC: Adding query filter params (role.id=c93d9de09c0241e0afc667b948525e47, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=5634ac56eeac45b9a1585318d87f2a43) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:17.157670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:17.159330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:17.167407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 122/251] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:16 2022] GET /identity/v3/role_assignments?user.id=5634ac56eeac45b9a1585318d87f2a43&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=c93d9de09c0241e0afc667b948525e47 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:17.194851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41759354-b898-4dc9-928b-094d4e7329a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:17.195750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41759354-b898-4dc9-928b-094d4e7329a1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.196030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41759354-b898-4dc9-928b-094d4e7329a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.196302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41759354-b898-4dc9-928b-094d4e7329a1 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.197561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41759354-b898-4dc9-928b-094d4e7329a1 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:17.199093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41759354-b898-4dc9-928b-094d4e7329a1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:17.201509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 130/252] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:17 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:17.211637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:17.330612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:17.350517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8828b-db4f-47be-8a19-8f2f6fde4b44 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:17.398806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0c438-d1a7-47de-9a38-a9f474475bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:17.399723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0c438-d1a7-47de-9a38-a9f474475bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.400012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0c438-d1a7-47de-9a38-a9f474475bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.400296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0c438-d1a7-47de-9a38-a9f474475bc2 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/0eda1c2078b646648a114234b07f5c14/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.402461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0c438-d1a7-47de-9a38-a9f474475bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=45b6d7a4e16544b9afd17d4b531d1ac0, user_id=0eda1c2078b646648a114234b07f5c14, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:17.404295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0c438-d1a7-47de-9a38-a9f474475bc2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:17.435065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 123/253] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:17 2022] PUT /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/0eda1c2078b646648a114234b07f5c14/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:17.750707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35445-0701-4ee7-9e01-b5fdb12551ba None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.751734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35445-0701-4ee7-9e01-b5fdb12551ba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.752230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a35445-0701-4ee7-9e01-b5fdb12551ba None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.754070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 131/254] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:17.759037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77534e3-e6f3-40aa-a711-e4ae266226c2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.759332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77534e3-e6f3-40aa-a711-e4ae266226c2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.759617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77534e3-e6f3-40aa-a711-e4ae266226c2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.760658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.761143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.761353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 124/255] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:17.761799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.775907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:17.776246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:17.776471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:17.781904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:17.783356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:17.799447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:17.805758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:17.807198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:17.861622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 132/256] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:17.882947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:17.932717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 125/257] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:17.972852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:17.990034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a590b-6745-488b-a745-903bd45ba7e9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.026719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.028052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.028530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.029016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.040579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:18.049584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:18.050528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:18.051310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:18.058390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 133/258] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:18.060987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:18.078755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:18.128091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:18.172015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee1e8cd-c774-4b09-ae41-78458e620fe1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.207018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.208042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.208553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.209018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.209958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:18.210487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:18.212128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:18.221411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 134/259] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:18.227350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:18.242866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606fe834-8d13-447b-889a-595480fb3c38 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.327012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:18.359117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.359929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.360215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.360493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.361189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79bf9b4-6307-47d7-94f9-0a7865c58cab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.396202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:18.398342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.399522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.400002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.400514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] PATH_INFO: `/v3/users/2ef004299aed4f82aff535e3ae7255cb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.401907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] RBAC: Authorizing `identity:get_user(user_id=2ef004299aed4f82aff535e3ae7255cb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:18.403741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:18.404389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:18.405335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:18.406160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 126/260] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 433 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:18.409073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 135/261] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/users/2ef004299aed4f82aff535e3ae7255cb => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:18.415362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:18.415475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:18.522048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b574-1313-46cb-a8b1-1a94daec0939 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.585570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.586257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.586610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.587079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.622804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:18.710994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:18.712822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:18.733793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d9a21-e704-4e99-8463-d76a113d8159 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.818798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:18.819795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 136/262] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:18.822506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:18.859189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.859800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.860183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.860460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.861224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:18.861533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:18.862969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:18.866857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:18.881231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 127/263] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:18.891433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:18.928652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30003c7a-b042-4d15-a30c-3d916295d7f1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:18.964168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:18.965457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:18.965939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:18.966401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:18.967805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:18.969548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:18.976514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 137/264] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:18.977883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:19.042029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd443c8-d1ae-455c-b50d-8157278f3e52 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:19.095668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5fe57d-7d33-4efc-a80c-5cb85f7ca7c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:19.104895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:19.106128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.106241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.106555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] PATH_INFO: `/v3/users/2ef004299aed4f82aff535e3ae7255cb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.109129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] RBAC: Authorizing `identity:get_user(user_id=2ef004299aed4f82aff535e3ae7255cb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:19.110675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:19.114830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:19.115838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 128/265] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/users/2ef004299aed4f82aff535e3ae7255cb => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:19.118056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:19.168150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:19.169156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.169590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.169875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.171339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] RBAC: Adding query filter params (role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=2ef004299aed4f82aff535e3ae7255cb) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:19.171663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:19.174609 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:19.182570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 138/266] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:18 2022] GET /identity/v3/role_assignments?user.id=2ef004299aed4f82aff535e3ae7255cb&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=8835b245e6e44fbb929afd739098a927 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:19.214810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:19.278878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e782d-17f9-4b30-bc3c-57cfb48d8995 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:19.331179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:19.331847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.332132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.332407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.440082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:19.441606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:19.510447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:19.561571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 129/267] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:19.567221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:19.721255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0acca8-be93-476e-82b1-9a3f0df32819 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:19.765108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333505b-8eb9-4e29-9997-5b2aef3ee486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:19.765971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333505b-8eb9-4e29-9997-5b2aef3ee486 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.766247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333505b-8eb9-4e29-9997-5b2aef3ee486 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.766545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333505b-8eb9-4e29-9997-5b2aef3ee486 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.767741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333505b-8eb9-4e29-9997-5b2aef3ee486 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:19.769205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333505b-8eb9-4e29-9997-5b2aef3ee486 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:19.771146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 139/268] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:19 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:19.776842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:19.907923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574c922-0589-4a0c-8ee9-1e4150cc098d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:19.953644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:19.954707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.955202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.955647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.956734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=2ef004299aed4f82aff535e3ae7255cb) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:19.957184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f44cb-7103-49ab-9baf-87f7daf4ce6d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.957670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:19.958194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f44cb-7103-49ab-9baf-87f7daf4ce6d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.958702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760f44cb-7103-49ab-9baf-87f7daf4ce6d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.958803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb2240d-5ee2-4c8e-a62a-2254c8294352 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:19.960706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 140/269] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:44:19.966068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 130/270] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:19 2022] GET /identity/v3/role_assignments?user.id=2ef004299aed4f82aff535e3ae7255cb&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:19.967275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38a35-ed32-4995-9c1d-30c443a8fd31 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:19.967805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38a35-ed32-4995-9c1d-30c443a8fd31 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:19.968281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38a35-ed32-4995-9c1d-30c443a8fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:19.987746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-36b38a35-ed32-4995-9c1d-30c443a8fd31 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:19.989255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-36b38a35-ed32-4995-9c1d-30c443a8fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:20.042789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.099716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 141/271] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:20.103302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe726-d718-4961-acc4-ebb25e277231 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.103590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe726-d718-4961-acc4-ebb25e277231 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.103866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fe726-d718-4961-acc4-ebb25e277231 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.105251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 131/272] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:20.110462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.110762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.111047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.132031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:20.133306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:20.167873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe726-d718-4961-acc4-ebb25e277231 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.206787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.234845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 142/273] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:20.267785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.317499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fe726-d718-4961-acc4-ebb25e277231 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:20.360127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:20.362579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.363294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.363980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.373326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:20.373326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:20.376743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 132/274] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:20.382318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.391511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.395319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5083d-1849-4f6c-a4aa-b5d95928c801 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:20.433178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72abc193-9f93-47fc-b381-c727a4988629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:20.434039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc193-9f93-47fc-b381-c727a4988629 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.434981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc193-9f93-47fc-b381-c727a4988629 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.435269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72abc193-9f93-47fc-b381-c727a4988629 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.445450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72abc193-9f93-47fc-b381-c727a4988629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-72abc193-9f93-47fc-b381-c727a4988629 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:20.453687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:20.454675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:20.455509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 143/275] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:20.456334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e3832-78ae-42e2-9386-10870ca62e4d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.456398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e3832-78ae-42e2-9386-10870ca62e4d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.456636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e3832-78ae-42e2-9386-10870ca62e4d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.457921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 144/276] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:20.459025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d412d8-8884-463f-a193-bdb45e285699 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.459309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d412d8-8884-463f-a193-bdb45e285699 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.459695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d412d8-8884-463f-a193-bdb45e285699 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.460767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 145/277] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:20.461456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d412d8-8884-463f-a193-bdb45e285699 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.489252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.498802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0375ac0-a084-4c2e-b9bf-180fff6d3a86 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:20.533531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8eead-a2c7-4b3d-afe7-b4a200b30107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:20.534131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8eead-a2c7-4b3d-afe7-b4a200b30107 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.534443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8eead-a2c7-4b3d-afe7-b4a200b30107 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.534723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8eead-a2c7-4b3d-afe7-b4a200b30107 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.535432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8eead-a2c7-4b3d-afe7-b4a200b30107 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:20.536872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8eead-a2c7-4b3d-afe7-b4a200b30107 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:20.556619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 133/278] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:20 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:20.558095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.558380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.558702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.577027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:20.578625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:20.587528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d412d8-8884-463f-a193-bdb45e285699 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:20.628457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:20.629144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.629428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.629704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.630962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:20.631271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:20.633051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9756a84f-e38b-4c5e-a18c-32447577b978 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:20.643452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 146/279] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:20.644560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.644845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.645117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.664855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:20.666064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:20.669043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 134/280] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:20.670263 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.691086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.752616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 147/281] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:20.753486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.767777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.796230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1433084c-f560-425b-ad14-0401333b29d4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:20.838076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:20.839055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.839330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.839603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] PATH_INFO: `/v3/users/d82961bf14b142f6bfdf18d92e76ca89` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.857696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] RBAC: Authorizing `identity:get_user(user_id=d82961bf14b142f6bfdf18d92e76ca89)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:20.859815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:20.861680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 135/282] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/users/d82961bf14b142f6bfdf18d92e76ca89 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:20.862671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.885520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d560a44-3b38-4872-81d9-e678743ced48 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:20.923990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:20.925272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:20.925851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:20.926296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:20.938790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:20.947005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:20.947899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:20.948698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:20.953339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 148/283] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:20.954268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:20.972432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:20.992607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb27846-4609-4095-a6dd-8922f92b9932 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.040636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.041776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.042764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.043264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.047833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:21.061916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:21.070442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c5156-7f19-4dbb-86dc-e8bf0e4db145 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:21.072103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:21.072956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:21.073728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:21.077667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 136/284] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:21.083649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.111219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.112242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.112735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.113171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.114164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, user.id=d82961bf14b142f6bfdf18d92e76ca89, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:21.114694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.116595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.122829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 149/285] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 09:44:20 2022] GET /identity/v3/role_assignments?user.id=d82961bf14b142f6bfdf18d92e76ca89&scope.system=all&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:21.123989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.202482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057341b-7a4f-46ed-bdcc-56a7028dc3eb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.227489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:21.257488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a7f1e-f6c1-47d6-ac89-6c32dea61703 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.299185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.300402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.300927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.301461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.302333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:21.302781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.304384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.314669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 150/286] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:21.316668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.317354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.317633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.317906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.319627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:21.319627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.320713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.328763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.335397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 137/287] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:21.340788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.446206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3478d88-3ed9-4f87-9af7-62043bd6613b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.479269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:21.525968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.528920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.529407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.530961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] PATH_INFO: `/v3/users/0eda1c2078b646648a114234b07f5c14` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.535629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] RBAC: Authorizing `identity:get_user(user_id=0eda1c2078b646648a114234b07f5c14)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.537317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.539220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 151/288] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:21 2022] GET /identity/v3/users/0eda1c2078b646648a114234b07f5c14 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:21.545236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.563310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53ef2d-09aa-4b3d-b8d4-88172b4fffbf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.565857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:21.611017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.612243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.613631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.614751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] PATH_INFO: `/v3/users/5634ac56eeac45b9a1585318d87f2a43` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.618309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] RBAC: Authorizing `identity:get_user(user_id=5634ac56eeac45b9a1585318d87f2a43)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.619987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.623620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 138/289] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:21 2022] GET /identity/v3/users/5634ac56eeac45b9a1585318d87f2a43 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:21.629642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.738898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2330cf3-704d-4d25-8466-db7a6d9dcf02 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.772347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:21.779479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.780602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.782440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.784037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.785479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.787913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.793733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 139/290] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:21 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:21.799434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:21.818129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac788db5-6e2e-436c-8b29-672bd2d2de51 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.891349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35644051-f400-47b6-be35-6d905baad747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.891631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35644051-f400-47b6-be35-6d905baad747 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.891992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35644051-f400-47b6-be35-6d905baad747 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.892267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35644051-f400-47b6-be35-6d905baad747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.926761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372423e-659c-45b9-a7c9-8db2cd234953 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:21.961329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:21.962229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:21.962538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:21.962816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/5634ac56eeac45b9a1585318d87f2a43/roles/c93d9de09c0241e0afc667b948525e47` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:21.964767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=45b6d7a4e16544b9afd17d4b531d1ac0, user_id=5634ac56eeac45b9a1585318d87f2a43, role_id=c93d9de09c0241e0afc667b948525e47)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:21.966307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:21.983429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 140/291] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:21 2022] PUT /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/users/5634ac56eeac45b9a1585318d87f2a43/roles/c93d9de09c0241e0afc667b948525e47 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:44:22.044415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35644051-f400-47b6-be35-6d905baad747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:22.045888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35644051-f400-47b6-be35-6d905baad747 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:22.057666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:22.168855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 152/292] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:22.174606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:22.247715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:22.292135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ccdfa1-925a-4dd4-94e8-fb239f9e88d3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:22.327064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1146cab-5f1b-415b-a5ba-75f2bb7d27be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:22.327930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146cab-5f1b-415b-a5ba-75f2bb7d27be None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:22.328207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146cab-5f1b-415b-a5ba-75f2bb7d27be None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:22.328479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1146cab-5f1b-415b-a5ba-75f2bb7d27be None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:22.329661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146cab-5f1b-415b-a5ba-75f2bb7d27be None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:22.331138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1146cab-5f1b-415b-a5ba-75f2bb7d27be None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:22.333143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 141/293] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:22 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:22.338596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35644051-f400-47b6-be35-6d905baad747 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:22.442594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35644051-f400-47b6-be35-6d905baad747 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:22.450602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:22.485730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:22.486394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:22.486727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:22.487001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:22.487837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=0eda1c2078b646648a114234b07f5c14) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:22.488144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:22.489579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1d0eff-27e4-48d0-a943-fa801c9c0c8e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:22.496101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 153/294] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:22 2022] GET /identity/v3/role_assignments?user.id=0eda1c2078b646648a114234b07f5c14&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:22.956755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a4295-8e26-4b9d-921e-8de4a1be6a5d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:22.957269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a4295-8e26-4b9d-921e-8de4a1be6a5d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:22.957373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a4295-8e26-4b9d-921e-8de4a1be6a5d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:22.958956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 142/295] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:22.964097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:22.964383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:22.964663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:22.985822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:22.987374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:23.052189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bca4ec-6293-48af-8ce5-ed7d99b3325b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.052499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bca4ec-6293-48af-8ce5-ed7d99b3325b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.052774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bca4ec-6293-48af-8ce5-ed7d99b3325b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.054712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 143/296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:23.061241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.061602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.061932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.070542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 154/297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:23.087088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:23.088655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:23.103607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.188328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 144/298] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:23.209980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.218320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:23.224282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a13db4-3929-43f1-be63-db86caf59678 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.260089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.260887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.261171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.261445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.270468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:23.272845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:23.281204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:23.282266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:23.287476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 155/299] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:23.290158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.333376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a44851-137d-4e84-8bfb-c5dddc39432d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.382967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.384597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.385312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.385802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.387409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:23.389519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:23.391844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 145/300] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:23.397407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.414212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf521f-2130-40e8-b93f-c2e93ded49e1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.450968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.452031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.452031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.452324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.453066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:23.453415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:23.454956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:23.469029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 156/301] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:23.469976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.497613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:23.517787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d47172-bbe1-4031-a28c-a6ec5e723604 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.539752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:23.557178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc709227-c6ac-476e-ab42-0817ce3c781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.558539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709227-c6ac-476e-ab42-0817ce3c781b None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.558856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709227-c6ac-476e-ab42-0817ce3c781b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.559139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc709227-c6ac-476e-ab42-0817ce3c781b None admin] PATH_INFO: `/v3/groups` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.559863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc709227-c6ac-476e-ab42-0817ce3c781b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:23.561975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc709227-c6ac-476e-ab42-0817ce3c781b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:23.583408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 146/302] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jul 13 09:44:23 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:23.585463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c01943-087a-45d4-a6fd-e71773871998 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.585749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c01943-087a-45d4-a6fd-e71773871998 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.586033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c01943-087a-45d4-a6fd-e71773871998 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.587681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 147/303] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:23.588690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f1c6ee-1679-4995-b7b2-f8d4323624b2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.595336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.595691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.595900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.618490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:23.619737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:23.640703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.642858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.643373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.643878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] PATH_INFO: `/v3/users/38db1cf21f7d4d539bd3fe42e748d723` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.667013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] RBAC: Authorizing `identity:get_user(user_id=38db1cf21f7d4d539bd3fe42e748d723)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:23.669174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:23.672898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 157/304] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/users/38db1cf21f7d4d539bd3fe42e748d723 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:23.679067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.713011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 148/305] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:23.736065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:23.783733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:23.809946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0023fec-97c5-4e74-80ec-661d027d0d8e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.850862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.851811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.852092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.852410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.853248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] RBAC: Adding query filter params (role.id=c93d9de09c0241e0afc667b948525e47, user.id=38db1cf21f7d4d539bd3fe42e748d723, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:23.853562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:23.853673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6438155-332d-4720-87d8-5a83a7a99045 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:23.855274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:23.866031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 158/306] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/role_assignments?user.id=38db1cf21f7d4d539bd3fe42e748d723&scope.system=all&role.id=c93d9de09c0241e0afc667b948525e47 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:23.866780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:23.893519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:23.894354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:23.894674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:23.894957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:23.907988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:23.917024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:23.917979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:23.919654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:23.922558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 149/307] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:23.924962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:24.044352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446fc1a5-f846-4ea8-9c44-61d4aab25c39 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:24.080685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:24.081469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.081627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.081886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.082669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:24.082972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:24.084363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:24.098124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 159/308] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:24.099631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:24.205260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2721b351-9f39-489c-b3d8-00434fdc8cf4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:24.242653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acabfb5b-31b4-464e-87d5-127908b4b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:24.243585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabfb5b-31b4-464e-87d5-127908b4b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.243874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabfb5b-31b4-464e-87d5-127908b4b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.244154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acabfb5b-31b4-464e-87d5-127908b4b6f9 None admin] PATH_INFO: `/v3/users/d82961bf14b142f6bfdf18d92e76ca89` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.245352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabfb5b-31b4-464e-87d5-127908b4b6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=d82961bf14b142f6bfdf18d92e76ca89)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:24.247255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acabfb5b-31b4-464e-87d5-127908b4b6f9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:24.249025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 150/309] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:24 2022] GET /identity/v3/users/d82961bf14b142f6bfdf18d92e76ca89 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:24.254679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:24.265522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:24.362732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6b11f-0fdc-4405-a400-5fc00ef75e21 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:24.397557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515165cc-696e-473b-8db7-6c9380594b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:24.398503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515165cc-696e-473b-8db7-6c9380594b4d None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.398787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515165cc-696e-473b-8db7-6c9380594b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.399060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515165cc-696e-473b-8db7-6c9380594b4d None admin] PATH_INFO: `/v3/system/users/d82961bf14b142f6bfdf18d92e76ca89/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.400548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515165cc-696e-473b-8db7-6c9380594b4d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d82961bf14b142f6bfdf18d92e76ca89, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:24.402039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515165cc-696e-473b-8db7-6c9380594b4d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:24.418633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 160/310] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 13 09:44:24 2022] PUT /identity/v3/system/users/d82961bf14b142f6bfdf18d92e76ca89/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:24.511719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ee1f-fc0b-4a56-81d4-df37ddf16ee9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.512185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ee1f-fc0b-4a56-81d4-df37ddf16ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.512633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2ee1f-fc0b-4a56-81d4-df37ddf16ee9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.514228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 151/311] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:24.519964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.520384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.520760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.538782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:24.539983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:24.609116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:24.618860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 161/312] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:24.638905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2ee1f-fc0b-4a56-81d4-df37ddf16ee9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:24.681704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:24.749725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2ee1f-fc0b-4a56-81d4-df37ddf16ee9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:24.788237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:24.789538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.790001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.790499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.802851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:24.811162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:24.812059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:24.813126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 152/313] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:24.818212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:24.938301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb2656-594f-49b3-9095-a357e7e71ca2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:24.975470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:24.976139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:24.976416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:24.976682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:24.977434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:24.977733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:24.980675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:24.989545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 162/314] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:24.994911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:25.099627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:25.104621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd55ba1-28b6-4518-958a-0a331a867690 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:25.139605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:25.140799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.141266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.141772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] PATH_INFO: `/v3/users/5634ac56eeac45b9a1585318d87f2a43` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.143146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] RBAC: Authorizing `identity:get_user(user_id=5634ac56eeac45b9a1585318d87f2a43)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:25.144767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:25.146618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 153/315] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:24 2022] GET /identity/v3/users/5634ac56eeac45b9a1585318d87f2a43 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:25.155546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:25.224653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:25.264262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38da018-c47b-41d3-9d66-db446bb21348 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:25.297336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:25.298185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.298630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.299064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.369091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:25.370811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:25.433424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:25.473267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 163/316] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:25.478634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:25.582323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777968a8-a364-412a-89d7-303c496eaf66 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:25.616882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850935b-2c10-42b1-adf7-8d635bf79207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:25.617739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850935b-2c10-42b1-adf7-8d635bf79207 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.618013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850935b-2c10-42b1-adf7-8d635bf79207 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.618280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850935b-2c10-42b1-adf7-8d635bf79207 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.619476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850935b-2c10-42b1-adf7-8d635bf79207 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:25.620908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850935b-2c10-42b1-adf7-8d635bf79207 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:25.626930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 154/317] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:25 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:25.629226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:25.729911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d4445-0997-4595-8e60-7233b00d3157 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:25.765269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:25.765924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.766204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.766502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.767326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] RBAC: Adding query filter params (role.id=c93d9de09c0241e0afc667b948525e47, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0, user.id=5634ac56eeac45b9a1585318d87f2a43) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:25.767632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:25.769067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3897e2c-c5ad-4b54-9215-aa73a7d9cd35 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:25.775353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 164/318] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:25 2022] GET /identity/v3/role_assignments?user.id=5634ac56eeac45b9a1585318d87f2a43&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=c93d9de09c0241e0afc667b948525e47 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:25.829977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc8cbf-f0f1-47b1-975a-6f764f3c9478 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.830326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc8cbf-f0f1-47b1-975a-6f764f3c9478 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.830564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbc8cbf-f0f1-47b1-975a-6f764f3c9478 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.831946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 155/319] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:25.838038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3936dc-7e00-439e-80ba-3d41b6a766f9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.838336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3936dc-7e00-439e-80ba-3d41b6a766f9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.838615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3936dc-7e00-439e-80ba-3d41b6a766f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.856827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ee3936dc-7e00-439e-80ba-3d41b6a766f9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:25.858028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ee3936dc-7e00-439e-80ba-3d41b6a766f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:25.881262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:25.933848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 165/320] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:25.956681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc8cbf-f0f1-47b1-975a-6f764f3c9478 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:25.985435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ce772-c11c-47f6-a039-9575471f0fa2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.986029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ce772-c11c-47f6-a039-9575471f0fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.986525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889ce772-c11c-47f6-a039-9575471f0fa2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:25.988100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 166/321] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:25.993441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:25.993781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:25.994116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.000986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:26.014088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:26.015370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:26.083415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbc8cbf-f0f1-47b1-975a-6f764f3c9478 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.098631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 167/322] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:26.117694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.120898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.121879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.122398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.122398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.123613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:26.125035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:26.126945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 156/323] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:26.132223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.202227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:26.216805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d47ae-c4eb-4a87-ade6-474ca4250a23 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.243506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00811c19-2a7e-401d-b15c-78a5631d0a3a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.245268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:26.256113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.256672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.256952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.257241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.269612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:26.277252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:26.278369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:26.279205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 168/324] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:26.281826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.282517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.282799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.283068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] PATH_INFO: `/v3/groups` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.283987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:26.284834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.285234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:26.300267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 157/325] 10.222.0.17 () {60 vars in 1134 bytes} [Wed Jul 13 09:44:26 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:26.404192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b1e35a-4847-4c65-a619-4dcf700cc2d9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.442807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.443546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.443825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.444066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.444899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:26.445205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:26.446640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb5313-6c0e-4f99-8fe1-4c8ff01daf3d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:26.457790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 169/326] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:26.462553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.502661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe8430-f6df-40c1-95fc-a7c867e34dd3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.502952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe8430-f6df-40c1-95fc-a7c867e34dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.503146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe8430-f6df-40c1-95fc-a7c867e34dd3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.504528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 170/327] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:26.509569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.509853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.510130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.529772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:26.530986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:26.533090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:26.582201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e5383-0c32-4083-b2e2-b7fae1e50b70 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.624196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 171/328] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:26.626465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.626465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.626465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.626465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] PATH_INFO: `/v3/users/38db1cf21f7d4d539bd3fe42e748d723` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.627304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] RBAC: Authorizing `identity:get_user(user_id=38db1cf21f7d4d539bd3fe42e748d723)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:26.628747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:26.630369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 158/329] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:26 2022] GET /identity/v3/users/38db1cf21f7d4d539bd3fe42e748d723 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:26.635868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.648958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.686276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:26.756295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86711147-50a3-433c-9ecb-7daf31843dec None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.768298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8236b28-43b6-4b88-9f09-37e09927ea6f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:26.793544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.794837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.795321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.795788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] PATH_INFO: `/v3/system/users/38db1cf21f7d4d539bd3fe42e748d723/roles/c93d9de09c0241e0afc667b948525e47` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.798572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38db1cf21f7d4d539bd3fe42e748d723, role_id=c93d9de09c0241e0afc667b948525e47)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:26.800199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:26.805645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:26.806597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:26.806867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:26.807257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:26.811799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 172/330] 10.222.0.17 () {58 vars in 1334 bytes} [Wed Jul 13 09:44:26 2022] PUT /identity/v3/system/users/38db1cf21f7d4d539bd3fe42e748d723/roles/c93d9de09c0241e0afc667b948525e47 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:44:26.822162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:26.831533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:26.832513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:26.833315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 159/331] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:26.840406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:26.843752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:26.963407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b21c78-3849-48bb-9c4d-d5aa381ded5a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:27.007413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:27.008002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:27.008280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:27.008552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:27.009323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:27.009610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:27.011051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:27.021616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 173/332] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:27.027246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:27.131231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:27.141852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d56af-574e-4e06-b12b-09aa9bc2fa2c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:27.177257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483b3a9-8eeb-4f64-b87c-aa7b8a961e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:27.178138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b3a9-8eeb-4f64-b87c-aa7b8a961e28 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:27.178429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b3a9-8eeb-4f64-b87c-aa7b8a961e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:27.178716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483b3a9-8eeb-4f64-b87c-aa7b8a961e28 None admin] PATH_INFO: `/v3/users/d82961bf14b142f6bfdf18d92e76ca89` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:27.179929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b3a9-8eeb-4f64-b87c-aa7b8a961e28 None admin] RBAC: Authorizing `identity:get_user(user_id=d82961bf14b142f6bfdf18d92e76ca89)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:27.181366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483b3a9-8eeb-4f64-b87c-aa7b8a961e28 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:27.183351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 160/333] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:27 2022] GET /identity/v3/users/d82961bf14b142f6bfdf18d92e76ca89 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:27.189166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:27.267728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:27.306927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981594-a7d0-4a93-8984-e8b41bd71e91 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:27.341186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:27.341849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:27.342130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:27.342400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:27.343260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] RBAC: Adding query filter params (role.id=d5d3a107e30e45e0a7a53f71de611f4b, user.id=d82961bf14b142f6bfdf18d92e76ca89, scope.system=all) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:27.343570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:27.345025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb16af5-1953-4df0-b63f-34847603cfc6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:27.360304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 174/334] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 09:44:27 2022] GET /identity/v3/role_assignments?user.id=d82961bf14b142f6bfdf18d92e76ca89&scope.system=all&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:28.900564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885d11-0c23-4663-b689-b178cd29747e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:28.901574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885d11-0c23-4663-b689-b178cd29747e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:28.902049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf885d11-0c23-4663-b689-b178cd29747e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:28.903925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 161/335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:28.909157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:28.910000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:28.910495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:28.931111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:28.932666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:29.011034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 175/336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:29.050790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e022-638f-4d19-81fd-ec98c5a7dd4d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.051431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e022-638f-4d19-81fd-ec98c5a7dd4d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.051893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4e022-638f-4d19-81fd-ec98c5a7dd4d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.053714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 162/337] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:29.055003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:29.058541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.059255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.059750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.088850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:29.091907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:29.170467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:29.231845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 163/338] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 13 09:44:29.273212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4851d76-8373-4cf5-8d05-39ace53ca50b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:29.277064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:29.332041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:29.332863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.333148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.333415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.357565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:29.365475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:29.366400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:29.367237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 176/339] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:29.373716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:29.455172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:29.471069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2021a17-76d2-413c-ad49-57b4b7e66c83 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:29.528296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932e0e-8822-4226-a599-4a10010e5d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:29.529153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932e0e-8822-4226-a599-4a10010e5d06 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.529431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932e0e-8822-4226-a599-4a10010e5d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.529698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932e0e-8822-4226-a599-4a10010e5d06 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.558449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7932e0e-8822-4226-a599-4a10010e5d06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d7932e0e-8822-4226-a599-4a10010e5d06 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:29.576118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:29.577091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:29.577894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:29.579259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 164/340] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:29.580593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb257dbb-53e8-42da-8e33-6993d355f93c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.580873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb257dbb-53e8-42da-8e33-6993d355f93c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.582042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb257dbb-53e8-42da-8e33-6993d355f93c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.586490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 165/341] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:29.587338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb257dbb-53e8-42da-8e33-6993d355f93c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:29.597594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30992a-dd44-4d3a-9f6c-dcf5bce10008 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:29.622803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:29.691684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:29.692374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.692664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.692947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.693715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:29.694025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:29.695471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2d3b3-b633-4f15-8f55-3978ef56fb11 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:29.721092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 177/342] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:29.722347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.722683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.722964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.732554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb257dbb-53e8-42da-8e33-6993d355f93c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:29.749029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:29.750222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:29.771461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:29.772132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.772542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.772872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:29.773726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:29.774034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:29.775472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:29.785201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 166/343] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:29.786149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:29.822850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:29.894165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ff04e-3687-4bfd-82f5-15016fc908d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:29.897279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 178/344] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:29.898360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:29.929999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9982165-f32e-41d0-ae46-e82f3799d1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:29.930733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9982165-f32e-41d0-ae46-e82f3799d1ae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:29.931013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9982165-f32e-41d0-ae46-e82f3799d1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:29.931335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9982165-f32e-41d0-ae46-e82f3799d1ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.023919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9982165-f32e-41d0-ae46-e82f3799d1ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:30.025611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9982165-f32e-41d0-ae46-e82f3799d1ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:30.041753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57acdd7-da24-4c3b-a1c9-60d7b3e9e56b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.045526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.047421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.105941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.106716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.106996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.107268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.168253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 167/345] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:30.171181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20342d5e-604e-4b67-933a-09448d108b34 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.171181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20342d5e-604e-4b67-933a-09448d108b34 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.171351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20342d5e-604e-4b67-933a-09448d108b34 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.174225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 168/346] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:30.174594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20342d5e-604e-4b67-933a-09448d108b34 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.206615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:30.208138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:30.287569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20342d5e-604e-4b67-933a-09448d108b34 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.300223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.316531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 179/347] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:30.317358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.320760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.330194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745cbdf7-366d-46ac-b638-7e731985a826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.331441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cbdf7-366d-46ac-b638-7e731985a826 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.331911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cbdf7-366d-46ac-b638-7e731985a826 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.332370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745cbdf7-366d-46ac-b638-7e731985a826 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.344008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745cbdf7-366d-46ac-b638-7e731985a826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-745cbdf7-366d-46ac-b638-7e731985a826 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:30.352489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:30.353461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:30.354268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:30.357156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 169/348] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:30.358632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.359108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.359566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.377742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:30.379206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:30.444871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365b742-5d31-4db6-8e5c-1e22b4371363 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.454563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 170/349] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:30.455737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.483277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.484365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.484650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.484928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.486777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:30.488495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:30.491257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 180/350] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:30.492603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.571681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.575716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5aa344-db0d-4e95-90f0-209935cf4307 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.598663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.618257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.619556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.620047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.620510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.623557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:30.625411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:30.627713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 171/351] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:30.628739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.637560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115a52-09e8-4ae1-9a42-659feb39647f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.691924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.692980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.693449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.693909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.694899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:30.695393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:30.696979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:30.710143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 181/352] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:30.711442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.771889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3976a-9277-4af9-8cb5-10617685ac26 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.812988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.813841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.814129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.814592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.828100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:30.835980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:30.836871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:30.838780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 172/353] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:30.839476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.845945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a32a9ce-04c3-4816-8318-0de5fa731857 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:30.880147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.891447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2a4cd6-d1d7-4e40-910a-47443e897476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:30.892323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4cd6-d1d7-4e40-910a-47443e897476 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.892604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4cd6-d1d7-4e40-910a-47443e897476 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.892880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2a4cd6-d1d7-4e40-910a-47443e897476 None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.895490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:30.904573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4cd6-d1d7-4e40-910a-47443e897476 None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:30.906044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2a4cd6-d1d7-4e40-910a-47443e897476 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:30.909541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 182/354] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:30.909541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d6077-c562-4b9e-96c5-1398b7bbb517 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:30.909942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d6077-c562-4b9e-96c5-1398b7bbb517 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:30.910120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d6077-c562-4b9e-96c5-1398b7bbb517 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:30.912581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 183/355] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:30.912581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d6077-c562-4b9e-96c5-1398b7bbb517 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:30.984714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356bcbc-b393-4341-901d-2911b55eedf7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.026361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.029121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.029121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.029121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.029400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.033137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.033137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 173/356] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:31.033137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.063839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d6077-c562-4b9e-96c5-1398b7bbb517 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.107799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e463a-7ca5-41fb-b59a-055a704c8bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.108379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e463a-7ca5-41fb-b59a-055a704c8bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.108660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e463a-7ca5-41fb-b59a-055a704c8bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.108932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e463a-7ca5-41fb-b59a-055a704c8bb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.151000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:31.157531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126c017-fdbf-45fa-a355-7353b6951f6f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.186338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:31.190247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e463a-7ca5-41fb-b59a-055a704c8bb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.192004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e463a-7ca5-41fb-b59a-055a704c8bb0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.202984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.204214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.204488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.205805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.205805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:31.206118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.207522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.216826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 174/357] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:31.219626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.315022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 184/358] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:31.318044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3288f2-b7ef-46c8-abad-813f3bac7b52 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.318750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3288f2-b7ef-46c8-abad-813f3bac7b52 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.318750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3288f2-b7ef-46c8-abad-813f3bac7b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.332342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab9f24-ec11-4490-9a91-368544af5b1d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.337279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0c3288f2-b7ef-46c8-abad-813f3bac7b52 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:31.338544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0c3288f2-b7ef-46c8-abad-813f3bac7b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:31.375599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.376721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.377144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.377627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.378490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:31.378857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.380301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.388767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 175/359] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:31.389926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.419859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:31.434919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 185/360] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:31.442438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54e68-e746-4d5e-b194-752465d2235e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.442438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54e68-e746-4d5e-b194-752465d2235e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.442438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c54e68-e746-4d5e-b194-752465d2235e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.442438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 186/361] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:31.442438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54e68-e746-4d5e-b194-752465d2235e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.481553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:31.548322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff6000-ae4a-4654-b586-69b5df580715 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.585561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c54e68-e746-4d5e-b194-752465d2235e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.591930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.592603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.592885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.593158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.595457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:31.595457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.596587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.603161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 176/362] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=8835b245e6e44fbb929afd739098a927 => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:31.603992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.628769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c14c8-05b6-4105-92a6-59e124f8a73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.630522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c14c8-05b6-4105-92a6-59e124f8a73f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.630953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c14c8-05b6-4105-92a6-59e124f8a73f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.631440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c14c8-05b6-4105-92a6-59e124f8a73f None admin] PATH_INFO: `/v3/users/38db1cf21f7d4d539bd3fe42e748d723` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.633008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c14c8-05b6-4105-92a6-59e124f8a73f None admin] RBAC: Authorizing `identity:get_user(user_id=38db1cf21f7d4d539bd3fe42e748d723)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.635563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c14c8-05b6-4105-92a6-59e124f8a73f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.638500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 187/363] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/users/38db1cf21f7d4d539bd3fe42e748d723 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:31.640057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.640470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.640869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.662160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:31.664298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:31.730264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:31.744995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2198d416-c469-4625-8326-39c3c7fe3c15 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.764001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 188/364] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:31.765348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.802150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:31.813529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.814462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.814747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.815016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.816245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:31.817666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:31.826529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 177/365] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:31.827470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:31.896275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb176c1e-07fd-4dbf-a9c4-1fbba83c3f40 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.947895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:31.948732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:31.949489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:31.950536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:31.958880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0a201-df8b-4457-a191-7ba7518b538d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:31.964984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:31.976123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:31.977056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:31.977852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:31.983031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 189/366] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:31.984993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.004725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.006117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.006635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.007127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.008223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] RBAC: Adding query filter params (role.id=c93d9de09c0241e0afc667b948525e47, user.id=38db1cf21f7d4d539bd3fe42e748d723, scope.system=all) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:32.008736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.010440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.024456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 178/367] 10.222.0.17 () {56 vars in 1308 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/role_assignments?user.id=38db1cf21f7d4d539bd3fe42e748d723&scope.system=all&role.id=c93d9de09c0241e0afc667b948525e47 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:32.025595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.061207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:32.107005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:32.128607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070d6cc-33ca-4cd8-bde8-220cc72caf7d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.175961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.177129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.177550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.177982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.192973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:32.202434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:32.203575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:32.204533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:32.206562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 190/368] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:32.207636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.272259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b24ec-0a4c-4ae8-918a-f5636616790e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.322635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.324523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.325013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.325698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.327295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.329664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.332457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 179/369] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:32 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:32.333428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.334792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3c645-fbf3-47a4-9503-6bac9ecc24ed None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.389351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.390384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.390931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.391803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.392768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:32.393268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.395401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.410526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 191/370] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:32.412195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.431490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:32.475025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:32.498086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108fac1-9524-4afe-a20e-628834e12728 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.530448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd99981-878d-43e7-9046-851275935bc2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.536459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.537399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.537875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.538347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.539410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:32.539908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.541595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.552859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 180/371] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:32.554174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.568390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.569022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.569298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.569618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.570457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:32.570771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.572228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.582447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 192/372] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:32 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:32.582447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:32.658898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:32.695064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fbe64-5e49-4bf2-990a-772e251bbc83 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.716317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94438a-41f2-4a41-8870-200a11347f08 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:32.730132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.734084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.734084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.734084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.781135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:32.784377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:32.784663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:32.784941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:32.834805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:32.846716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.851001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.931046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:32.933399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:32.988345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:33.060184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 181/373] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:33.065547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 193/374] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:33.066575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:33.071049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:33.120491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:33.192681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54161a7-92a4-4d6e-bbfd-c5d1b970664a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:33.233510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:33.234793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.235328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.235814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.237232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:33.238949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:33.241913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 182/375] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:33.250374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:33.325067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83715ab-8d3f-4e44-a2ec-8777a88b11e9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:33.424151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750618d-53e4-4cee-9e3f-4c86fb9b5185 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:33.431151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:33.432125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.432413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.432695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] PATH_INFO: `/v3/projects/a135dccee4ed45239317c87dab2bda38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.434009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] RBAC: Authorizing `identity:get_project(project_id=a135dccee4ed45239317c87dab2bda38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:33.435554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:33.437615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 194/376] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/projects/a135dccee4ed45239317c87dab2bda38 => generated 344 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:33.438853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:33.443081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:33.462792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:33.463820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.464487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.464487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.466445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:33.467914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:33.469779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 183/377] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:33.475424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:33.551665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:33.593467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dafee40-2cf8-4102-952b-54548915246a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:33.632025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:33.632510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.632796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.633090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.633903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:33.634218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:33.635705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:33.654890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 184/378] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=8835b245e6e44fbb929afd739098a927 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:33.708712 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c739bb40-057b-441a-b5ae-9d1cb8a980f3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:33.763926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999aab15-2175-46cf-a12d-9257ba615242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:33.764799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aab15-2175-46cf-a12d-9257ba615242 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.765075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aab15-2175-46cf-a12d-9257ba615242 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.765453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999aab15-2175-46cf-a12d-9257ba615242 None admin] PATH_INFO: `/v3/groups/d7108d41493143c0afc5b1b2e6dacbf6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.775871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999aab15-2175-46cf-a12d-9257ba615242 None admin] RBAC: Authorizing `identity:get_group(group_id=d7108d41493143c0afc5b1b2e6dacbf6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:33.777485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999aab15-2175-46cf-a12d-9257ba615242 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:33.779557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 195/379] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/groups/d7108d41493143c0afc5b1b2e6dacbf6 => generated 229 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:33.785563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:33.826733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2d72a-0674-464d-aab2-9310eeeba46c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.827335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2d72a-0674-464d-aab2-9310eeeba46c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.827803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2d72a-0674-464d-aab2-9310eeeba46c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.829623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 196/380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:44:33.835084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:33.835620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:33.836087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:33.847261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:33.857575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:33.859266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:33.941396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 197/381] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:33.945954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2121223-4aad-4304-823f-d98cbd1b1e31 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:33.961373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.000574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:34.016167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.016846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.017115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.017481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.018210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] RBAC: Adding query filter params (group.id=d7108d41493143c0afc5b1b2e6dacbf6, role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=a135dccee4ed45239317c87dab2bda38) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:34.018539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:34.019970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e2be-a014-4307-807e-74617379a954 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:34.031513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 185/382] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/role_assignments?group.id=d7108d41493143c0afc5b1b2e6dacbf6&scope.project.id=a135dccee4ed45239317c87dab2bda38&role.id=757ccd03cb5e4f109673558436a31b66 => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:34.085890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0363bd-5316-4c02-ae35-b0b11944a09a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:34.091522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26268505-c233-4ccc-9282-638e304fb104 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.092453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26268505-c233-4ccc-9282-638e304fb104 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.092942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26268505-c233-4ccc-9282-638e304fb104 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.095127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 186/383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:34.104108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.104948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.105856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.130329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:34.132013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:34.132211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.133000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.133282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.133559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.146771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:34.155159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:34.156197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:34.157066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:34.159452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 198/384] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:34.164781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.226711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 187/385] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:34.265936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.276684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:34.286273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8e5f1-416c-4d3e-a921-239d4ba5dcc8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:34.311482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:34.328887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.330288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.330820 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.331287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.332333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:34.332900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:34.334508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:34.350024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 199/386] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:34.352382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.434220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619da730-d2e2-4a97-a1a2-6e6aead6c6fd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:34.503392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.506241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.506776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.509004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3a872-74ca-46b1-9e57-b2c0302ab7a1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:34.509528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.533649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:34.544116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:34.545098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:34.545907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:34.549540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 188/387] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:34.562339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.592028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.593002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.593289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.593567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.595015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:34.596463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:34.598319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 200/388] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:34 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:34.607598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.649633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:34.702782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:34.707702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb9da1-d0aa-4c32-b3f6-5bbc066026bc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:34.780701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.781391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.781676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.781955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.782740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:34.783051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:34.784432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:34.793283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7ae47f-ea3c-4ce6-8860-a869a8b8be3b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:34.808551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 189/389] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:34.814603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:34.869008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:34.869817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:34.870099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:34.870377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:34.872375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:34.873845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:34.875638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 201/390] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:34 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:34.882154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:35.040631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198a10d-c7b2-42d7-88e7-dcde51b4342a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.041319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:35.053682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f1822-56f8-444b-911a-910f5af8d1ab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.093676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.094990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.095278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.095556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.099886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407, group_id=d006fb8cb82b4184ad9994c1f2ffccc2, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:35.101360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:35.120221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 202/391] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 09:44:34 2022] PUT /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:35.140628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede285e7-a971-4db3-92d0-82c4bf01391f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.141577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede285e7-a971-4db3-92d0-82c4bf01391f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.141858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede285e7-a971-4db3-92d0-82c4bf01391f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.142185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede285e7-a971-4db3-92d0-82c4bf01391f None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.143809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede285e7-a971-4db3-92d0-82c4bf01391f None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:35.145337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede285e7-a971-4db3-92d0-82c4bf01391f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:35.147512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 190/392] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:34 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:35.153432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:35.176210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5aafb-2f5a-4361-93e7-e7e465f504b4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.176535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5aafb-2f5a-4361-93e7-e7e465f504b4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.176752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e5aafb-2f5a-4361-93e7-e7e465f504b4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.178403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 191/393] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:35.184118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.184403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.184683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.203565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:35.204795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:35.226845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:35.281875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 192/394] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:35.307122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:35.338634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc716c-3b8e-47c6-8502-31eef87828a1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.399294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.400264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.400613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.400976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.402680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:35.404682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:35.407212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 203/395] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:35 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:35.414957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:35.446860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:35.478915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df222048-12c1-4e1d-959c-6693f76b235c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.520426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.521484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.521972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.522443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.533837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:35.541636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aca6d1-d148-41e0-a63c-f4015947de95 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:35.542672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:35.543626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:35.544454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:35.547670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 193/396] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:35.560913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:35.598825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:35.608026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.608970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.609284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.609559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.613827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407, group_id=d006fb8cb82b4184ad9994c1f2ffccc2, role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:35.615360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:35.639832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 204/397] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 09:44:35 2022] PUT /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/8835b245e6e44fbb929afd739098a927 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:35.705944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9c5b5-6beb-4caf-b0fa-62f287d93b4a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.742173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.742880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.743159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.743431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.744175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:35.744478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:35.745865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:35.756264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 194/398] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:35.761935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:35.865992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:35.891119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4ac35-c307-4a0a-91d5-90e3bcf797d3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:35.931632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:35.932733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:35.933181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:35.933656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:35.934971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:35.936553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:35.939080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 205/399] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:35 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:35.944652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:36.031368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:36.054865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7b1e7-f7f6-44bd-af76-bd70f0c052e7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:36.091019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77aa789-fab6-4039-b880-f2ec6b44052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:36.091982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa789-fab6-4039-b880-f2ec6b44052a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.092261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa789-fab6-4039-b880-f2ec6b44052a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.092533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77aa789-fab6-4039-b880-f2ec6b44052a None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.093801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa789-fab6-4039-b880-f2ec6b44052a None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:36.095268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77aa789-fab6-4039-b880-f2ec6b44052a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:36.097280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 195/400] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:35 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:36.102874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:36.225190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939c153-3269-4f15-b4f9-d477b425c06b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:36.276183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c90a06-c04f-4194-89c4-d4ed877af64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:36.277067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90a06-c04f-4194-89c4-d4ed877af64b None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.277399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90a06-c04f-4194-89c4-d4ed877af64b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.277673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c90a06-c04f-4194-89c4-d4ed877af64b None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.279780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90a06-c04f-4194-89c4-d4ed877af64b None admin] RBAC: Authorizing `identity:create_grant(project_id=45b6d7a4e16544b9afd17d4b531d1ac0, group_id=d006fb8cb82b4184ad9994c1f2ffccc2, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:36.281227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c90a06-c04f-4194-89c4-d4ed877af64b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:36.301780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 206/401] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 09:44:36 2022] PUT /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:36.452700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff233-131f-4d6f-af8d-bcaba8faa069 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.453217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff233-131f-4d6f-af8d-bcaba8faa069 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.453217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ff233-131f-4d6f-af8d-bcaba8faa069 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.454898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 196/402] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:36.460298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a4a9-6b42-4675-b64c-1857cf98b64a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.460926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a4a9-6b42-4675-b64c-1857cf98b64a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.460926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33a4a9-6b42-4675-b64c-1857cf98b64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.478902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ae33a4a9-6b42-4675-b64c-1857cf98b64a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:36.480008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ae33a4a9-6b42-4675-b64c-1857cf98b64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:36.482323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:36.568761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 207/403] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:36.591981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ff233-131f-4d6f-af8d-bcaba8faa069 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:36.691004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b97c-e839-495b-b42c-dc4954dc7ae3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.691366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b97c-e839-495b-b42c-dc4954dc7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.691559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42b97c-e839-495b-b42c-dc4954dc7ae3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.693343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 208/404] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:36.700950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.700950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.700950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.716188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ff233-131f-4d6f-af8d-bcaba8faa069 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:36.719270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:36.720700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:36.775243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:36.775978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:36.776261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:36.776534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:36.797501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 209/405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:36.805546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:36.813321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:36.814200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:36.815066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:36.818610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 197/406] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:36.824558 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:36.836386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:36.846763 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:36.951721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:37.005320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc19b7-51de-4326-a0aa-27867c74f6c4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.047402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc718a-23dc-4a0a-8f9c-e9a26874a6e2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.047710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.048372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.048651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.048930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.049694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:37.049984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.052270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.072756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 210/407] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:37.078012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.111380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.113944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.116436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.116943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.141284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:37.156845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:37.157809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:37.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:37.163140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 198/408] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:37.169568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.278631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ae2a-9600-42e0-8f50-281e6e36aa0c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.300794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:37.340620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9bf016-8707-45f3-a4f3-b86ab3d60db9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.345785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:37.366752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.367241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.368772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.368772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] PATH_INFO: `/v3/groups/d7108d41493143c0afc5b1b2e6dacbf6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.375146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] RBAC: Authorizing `identity:get_group(group_id=d7108d41493143c0afc5b1b2e6dacbf6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.379770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.379770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 211/409] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:37 2022] GET /identity/v3/groups/d7108d41493143c0afc5b1b2e6dacbf6 => generated 229 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:37.384975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.385829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.386253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.386781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.387554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.387863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:37.388619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.390148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.400024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 199/410] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:37.405722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.511635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac516e2-1522-47cd-98e3-e1370b82a715 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.541142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:37.551220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.552413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.552897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.553377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.554823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.556519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.558753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 200/411] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:37 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:37.564403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.671957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ef05-ccc6-4c9d-9162-36ac1f73bb06 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.681839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa67a-086c-44bc-96ae-01b2683c2be7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.711836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c401a5-7078-4365-8f62-af4e83a3adbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.713015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c401a5-7078-4365-8f62-af4e83a3adbf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.713300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c401a5-7078-4365-8f62-af4e83a3adbf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.713566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c401a5-7078-4365-8f62-af4e83a3adbf None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.715205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c401a5-7078-4365-8f62-af4e83a3adbf None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.717223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c401a5-7078-4365-8f62-af4e83a3adbf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.718508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc0248-78c0-4021-a531-b40c874e7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.719400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 201/412] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:37 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:37.724009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484978-5275-4343-86c5-821e1875ba3a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.724009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484978-5275-4343-86c5-821e1875ba3a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.724009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b484978-5275-4343-86c5-821e1875ba3a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.724009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 202/413] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:37.724696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0248-78c0-4021-a531-b40c874e7edd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.724864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484978-5275-4343-86c5-821e1875ba3a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.725358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0248-78c0-4021-a531-b40c874e7edd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.725832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc0248-78c0-4021-a531-b40c874e7edd None admin] PATH_INFO: `/v3/projects/a135dccee4ed45239317c87dab2bda38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.727542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc0248-78c0-4021-a531-b40c874e7edd None admin] RBAC: Authorizing `identity:get_project(project_id=a135dccee4ed45239317c87dab2bda38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.730551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc0248-78c0-4021-a531-b40c874e7edd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.732826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 212/414] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:37 2022] GET /identity/v3/projects/a135dccee4ed45239317c87dab2bda38 => generated 344 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:37.734326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.734845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.735350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.755831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:37.758155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:37.810253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:37.839132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:37.849466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 213/415] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:37.857299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.876147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b484978-5275-4343-86c5-821e1875ba3a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:37.912885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:37.914117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:37.914621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:37.915114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:37.917722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] RBAC: Authorizing `identity:create_grant(project_id=45b6d7a4e16544b9afd17d4b531d1ac0, group_id=d006fb8cb82b4184ad9994c1f2ffccc2, role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:37.919438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:37.938976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 203/416] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 09:44:37 2022] PUT /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0/groups/d006fb8cb82b4184ad9994c1f2ffccc2/roles/8835b245e6e44fbb929afd739098a927 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:37.940343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:37.975883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7ffe2-d4f4-4f39-9cf9-9a3da72e5ea2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.014384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.015320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.015595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.015862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] PATH_INFO: `/v3/projects/a135dccee4ed45239317c87dab2bda38/groups/d7108d41493143c0afc5b1b2e6dacbf6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.017961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] RBAC: Authorizing `identity:create_grant(project_id=a135dccee4ed45239317c87dab2bda38, group_id=d7108d41493143c0afc5b1b2e6dacbf6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:38.019437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:38.042529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 214/417] 10.222.0.17 () {58 vars in 1442 bytes} [Wed Jul 13 09:44:37 2022] PUT /identity/v3/projects/a135dccee4ed45239317c87dab2bda38/groups/d7108d41493143c0afc5b1b2e6dacbf6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:38.080746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d73386-653b-4333-bba8-3ecbe7aba878 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.119177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:38.137262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee6c54f-285e-46a5-98af-c4daaaabd27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.139154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6c54f-285e-46a5-98af-c4daaaabd27a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.139678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6c54f-285e-46a5-98af-c4daaaabd27a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.140192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee6c54f-285e-46a5-98af-c4daaaabd27a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.158401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee6c54f-285e-46a5-98af-c4daaaabd27a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bee6c54f-285e-46a5-98af-c4daaaabd27a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:38.166600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:38.167551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:38.168437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:38.169542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 204/418] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:38.174593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:38.189214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6fc6-ef16-42fe-9b53-4b6c6e706dad None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.189567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6fc6-ef16-42fe-9b53-4b6c6e706dad None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.189846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863f6fc6-ef16-42fe-9b53-4b6c6e706dad None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.191567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 205/419] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:38.201355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.201661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.201912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.226550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:38.228146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:38.257901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:38.316470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5be80f-0471-4e8a-aa1d-06fb72d09032 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.317925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 206/420] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:38.341601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:38.369424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.370595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.371311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.372734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.374820 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] RBAC: Adding query filter params (name=member) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:38.377022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:38.378513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:38.398306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 215/421] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:38.403654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:38.509597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4782032-a817-454a-bdda-fce532f8bc32 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.527752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:38.554373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.555607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.556580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.557047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.571246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:38.581020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:38.581938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:38.582774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:38.585549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 207/422] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:38.590941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:38.622636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb14683-fb97-498d-9481-767a0f4baeef None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.671879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:38.710344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdc9483-3791-4988-986b-c659abe5ba36 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.713301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adbbeb-6275-4ccb-a25e-8dd22d00a1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.713958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adbbeb-6275-4ccb-a25e-8dd22d00a1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.714238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adbbeb-6275-4ccb-a25e-8dd22d00a1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.714537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adbbeb-6275-4ccb-a25e-8dd22d00a1e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.774681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.775684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.776109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.776519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:38.777750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:38.778211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:38.780433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:38.812007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 208/423] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:38.818523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:38.840026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adbbeb-6275-4ccb-a25e-8dd22d00a1e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:38.841632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adbbeb-6275-4ccb-a25e-8dd22d00a1e5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:38.865487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:38.953077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392d895-1d60-4d73-ae7c-180eccadc56b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:38.993793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41f3ee-cbb0-4229-9c5f-7b3a4e07e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:38.994989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41f3ee-cbb0-4229-9c5f-7b3a4e07e360 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:38.995475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41f3ee-cbb0-4229-9c5f-7b3a4e07e360 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:38.996105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41f3ee-cbb0-4229-9c5f-7b3a4e07e360 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.004311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 216/424] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:39.009892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4532-dc76-49a9-9699-c90c21d5c17f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.009892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4532-dc76-49a9-9699-c90c21d5c17f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.009892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a4532-dc76-49a9-9699-c90c21d5c17f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.009892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 217/425] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:39.012136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4532-dc76-49a9-9699-c90c21d5c17f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.031808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.082022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41f3ee-cbb0-4229-9c5f-7b3a4e07e360 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.083545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41f3ee-cbb0-4229-9c5f-7b3a4e07e360 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.121271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.155412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a4532-dc76-49a9-9699-c90c21d5c17f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.191887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 209/426] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:39.193086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.193297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.193579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.202521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.204908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.205388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.205860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.207352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.209496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.211772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 218/427] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:39.217033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.218217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:39.219634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:39.294513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 210/428] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:39.295418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.323790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.341755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2b337-4fea-44b7-8a55-eb415683af32 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.387501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.389681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.390172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.390788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] PATH_INFO: `/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.392870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] RBAC: Authorizing `identity:get_project(project_id=1b9a58f2ba6f4b959c8ea5733ce2f407)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.396252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.397925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.400726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 219/429] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/projects/1b9a58f2ba6f4b959c8ea5733ce2f407 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:39.401838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.454298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41503b64-282e-42a6-a721-84597c115aa1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.493152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.493742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.494073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.494354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.495558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.497224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.503638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 211/430] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:39.503638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.522322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1a02-335f-4216-820c-50302570a3bc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.557878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.558999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.559383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.559755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.570630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:39.578787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:39.579931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 13 09:44:39.580934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:39.582579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 220/431] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:39.583437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.604542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.615098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6461f-2348-45c7-b6d0-09eb9dad41b8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.652931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.654116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.654574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.655018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.656335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.658042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.660191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 212/432] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:39.661123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.663957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.702682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b015540-63ed-4d17-8396-e2155d6c80a9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.739550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.740196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.740586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.740935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.741834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:39.742215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.743822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.758448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 221/433] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:39.758448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.800695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87928390-831f-47d8-b000-ca3d288e3c4e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.870042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.870756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.871215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.871593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.871912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.872362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] RBAC: Adding query filter params (name=member) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:39.872898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.874057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:39.883730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 213/434] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:39.890158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:39.929161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd08c7-ee73-4692-8de6-0fd4a10b3537 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:39.986811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:39.988420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:39.989098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:39.989400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:39.989629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:39.990489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:39.990798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:39.993134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7acc1-6720-472c-8770-d807b4b2d519 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:40.001075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 222/435] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=1b9a58f2ba6f4b959c8ea5733ce2f407&role.id=8835b245e6e44fbb929afd739098a927 => generated 611 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:40.033078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e30da-8c2d-4a9e-b6a6-f5f908065abd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.076997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.077747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.078093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.078392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.167005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:40.168587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:40.239322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.283985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 214/436] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:40.287926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210e883-6c38-4950-8b87-e54b434ecb69 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.288283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210e883-6c38-4950-8b87-e54b434ecb69 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.288556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210e883-6c38-4950-8b87-e54b434ecb69 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.289024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.291322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 223/437] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:40.297303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f5b9e-204f-4840-bd5b-71cc9f31d528 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.297877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f5b9e-204f-4840-bd5b-71cc9f31d528 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.298361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4f5b9e-204f-4840-bd5b-71cc9f31d528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.319335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1b4f5b9e-204f-4840-bd5b-71cc9f31d528 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:40.321267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1b4f5b9e-204f-4840-bd5b-71cc9f31d528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:40.418744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de297324-8266-4ccc-a68f-9d9b9a78363f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.419494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 224/438] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:40.422756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfb502-ab7a-4e99-9c2a-0b36c8c6d1ac None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.422756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfb502-ab7a-4e99-9c2a-0b36c8c6d1ac None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.422756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfb502-ab7a-4e99-9c2a-0b36c8c6d1ac None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.422756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 225/439] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:40.428233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.428519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.428797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.447305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:40.448471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:40.465890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.466808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.467086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.467369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.468737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:40.470200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:40.471983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 215/440] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:40.472764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.509061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.535689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 226/441] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:40.536482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.541285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.596187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c422c6-9032-4972-9679-d6dab44c791d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.630586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.631400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.631679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.631951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.642526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:40.650366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:40.651305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:40.657521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:40.658291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd91600-638b-4caa-8722-0d6c1e2ef802 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.658376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 216/442] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:40.658376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.689631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.690523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.690804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.691072 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.692215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:40.693911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:40.695536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 227/443] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:40.696278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.747833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.758681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8037fb-17e3-41de-8034-8a1b658eeedc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.766678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.792044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.792847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.793128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.793403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.797212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3623f133-67df-44e1-aad5-d3cb08705fd0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.803515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:40.811316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:40.812211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:40.813007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 217/444] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:40.813655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.835424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.836084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.836362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.836622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.837359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:40.837658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:40.839051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:40.847236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 228/445] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:40.847996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.921256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41b3d1-1946-4da5-942a-b8120e004e07 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.946996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af426a8d-553c-4e50-b38a-69ebf57ffa5a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:40.957068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.957723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.958000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.958270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.959118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=d5d3a107e30e45e0a7a53f71de611f4b, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:40.959433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:40.960871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:40.967079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 218/446] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=d5d3a107e30e45e0a7a53f71de611f4b => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:40.967867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:40.988458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.991658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:40.997465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:40.998155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:40.998444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:40.998731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:40.999495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:40.999813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.001211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.010741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 229/447] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:41.017096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.094636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eacf39-4d03-4fa5-b857-211a4cf0972d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.132467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7577af0-71da-4630-9793-23e72cab546c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.140765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.141428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.141708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.142002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.175164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.177271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.177271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.177271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.227409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.228740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.244650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:41.253379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:41.255681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.259698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.351151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 219/448] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:41.357208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.370784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 230/449] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 13 09:44:41.376729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.460220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f5310-8471-4cd6-921b-d125d905add3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.469205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:41.476145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095147a2-99b0-4b81-b843-20dd8e45820c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.477932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:41.496419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.497090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.497369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.497637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] PATH_INFO: `/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.498835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] RBAC: Authorizing `identity:get_project(project_id=45b6d7a4e16544b9afd17d4b531d1ac0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.500289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.501981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 220/450] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/projects/45b6d7a4e16544b9afd17d4b531d1ac0 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:41.507373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.510329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.511229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.511543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.512431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] PATH_INFO: `/v3/projects/a135dccee4ed45239317c87dab2bda38` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.513926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] RBAC: Authorizing `identity:get_project(project_id=a135dccee4ed45239317c87dab2bda38)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.515399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.517087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 231/451] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/projects/a135dccee4ed45239317c87dab2bda38 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:41.522440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.612307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b8848-1f75-4be9-92ba-32b02e59dab2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.621749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20a06a-7d67-4680-9394-0820dbaa386e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.648576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.649434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.649716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.649987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] PATH_INFO: `/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.651232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] RBAC: Authorizing `identity:get_group(group_id=d006fb8cb82b4184ad9994c1f2ffccc2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.652837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.654535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 221/452] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/groups/d006fb8cb82b4184ad9994c1f2ffccc2 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:41.655877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.656731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.657017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.657275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] PATH_INFO: `/v3/groups/d7108d41493143c0afc5b1b2e6dacbf6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.658470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] RBAC: Authorizing `identity:get_group(group_id=d7108d41493143c0afc5b1b2e6dacbf6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.659884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.660286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.665945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 232/453] 10.222.0.17 () {56 vars in 1180 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/groups/d7108d41493143c0afc5b1b2e6dacbf6 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:41.666967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:41.695914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:41.715178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:41.761668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed5216-9c15-482b-b918-cb11bd396fbc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.765218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cd7b5-b25d-4ef6-b35e-5f50406027b5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:41.795775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.796440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.796723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.797001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.797869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] RBAC: Adding query filter params (group.id=d006fb8cb82b4184ad9994c1f2ffccc2, role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:41.798138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.799362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:41.799826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7aaecd-4b89-4bdc-9157-68191bec34c8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.800010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:41.800292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:41.800564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:41.801393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] RBAC: Adding query filter params (group.id=d7108d41493143c0afc5b1b2e6dacbf6, role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=a135dccee4ed45239317c87dab2bda38) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:41.801700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:41.803152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b31ea-12b9-47cf-b750-3aad917c9566 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:41.805822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 222/454] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/role_assignments?group.id=d006fb8cb82b4184ad9994c1f2ffccc2&scope.project.id=45b6d7a4e16544b9afd17d4b531d1ac0&role.id=8835b245e6e44fbb929afd739098a927 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:41.814362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 233/455] 10.222.0.17 () {56 vars in 1376 bytes} [Wed Jul 13 09:44:41 2022] GET /identity/v3/role_assignments?group.id=d7108d41493143c0afc5b1b2e6dacbf6&scope.project.id=a135dccee4ed45239317c87dab2bda38&role.id=757ccd03cb5e4f109673558436a31b66 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:44.360770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb92fb-6254-442e-9c1a-afe00a92fdc1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.361286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb92fb-6254-442e-9c1a-afe00a92fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.361571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb92fb-6254-442e-9c1a-afe00a92fdc1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.363249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 223/456] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:44.377851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4e58-d4fd-4919-b580-b879d487d3ae None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.378245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4e58-d4fd-4919-b580-b879d487d3ae None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.378440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea4e58-d4fd-4919-b580-b879d487d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.407026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-acea4e58-d4fd-4919-b580-b879d487d3ae None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:44.408266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-acea4e58-d4fd-4919-b580-b879d487d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:44.502207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 234/457] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:44.549179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb92fb-6254-442e-9c1a-afe00a92fdc1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:44.682624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb92fb-6254-442e-9c1a-afe00a92fdc1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:44.708468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:44.731629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:44.732439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.732722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.732998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.748049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:44.749510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:44.771003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07163b-209b-4344-a4ac-2967b917d9b3 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.771613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07163b-209b-4344-a4ac-2967b917d9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.772121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07163b-209b-4344-a4ac-2967b917d9b3 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0ed9ed6f-d517-4440-b6f7-cc26ebb62f57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:44.776090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:44.777402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:44.778289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:44.778289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:44.778289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:44.778289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:44.778289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 224/459] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:44.778910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 235/459] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:44.782204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3040-1459-45eb-8fe4-fa65a44dae04 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.782325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02870b0-f510-4331-a8a1-bcaa05ffad7b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.782543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02870b0-f510-4331-a8a1-bcaa05ffad7b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.782792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02870b0-f510-4331-a8a1-bcaa05ffad7b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.783215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3040-1459-45eb-8fe4-fa65a44dae04 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.783692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea3040-1459-45eb-8fe4-fa65a44dae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.784372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 225/460] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:44.785138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02870b0-f510-4331-a8a1-bcaa05ffad7b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:44.801445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ffea3040-1459-45eb-8fe4-fa65a44dae04 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:44.802995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ffea3040-1459-45eb-8fe4-fa65a44dae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:44.834819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:44.871387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 236/461] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:44.882541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.882837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.883119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.908239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:44.909088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02870b0-f510-4331-a8a1-bcaa05ffad7b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:44.909431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:44.947728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:44.948744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:44.949278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:44.949908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:44.950874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:44.951398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:44.952967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:44.965962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 226/462] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:44.967219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:44.990338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 237/463] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:44.991213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.000695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.076058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96e4b2-6a3b-44f3-97ee-22b6cbe367ef None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.081657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.098165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f0d6e-89cb-4b0d-ae09-c71eddaf8426 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.112343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.113474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.113963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.114450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.126286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.127990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.134182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1f0da-ca06-4e2b-884a-b5fab2d7a576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.135073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1f0da-ca06-4e2b-884a-b5fab2d7a576 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.135560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1f0da-ca06-4e2b-884a-b5fab2d7a576 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.136026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1f0da-ca06-4e2b-884a-b5fab2d7a576 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.137033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1f0da-ca06-4e2b-884a-b5fab2d7a576 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.139050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f1f0da-ca06-4e2b-884a-b5fab2d7a576 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:45.146168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:45.147068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:45.148228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:45.148228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:45.148228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:45.148228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:45.150495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 227/464] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:45.151055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.162815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 238/465] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:44 2022] POST /identity/v3/users => generated 246 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:45.164801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189a67f-443a-419f-8ebd-a3724ef68302 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.165593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189a67f-443a-419f-8ebd-a3724ef68302 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.166027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189a67f-443a-419f-8ebd-a3724ef68302 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.168781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 239/466] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:45.169857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189a67f-443a-419f-8ebd-a3724ef68302 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.259156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.283505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0f9e-ef36-44cd-805b-f15f62e8047b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.331372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189a67f-443a-419f-8ebd-a3724ef68302 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.332314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.333179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.333462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.333740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.345728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.347439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-065a14b0-1f5a-4001-a59d-b378fcb2d6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:45.366488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:45.367798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:45.368654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:45.368654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:45.368654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:45.368654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:45.368654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 228/467] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:45.369354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.369354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.369596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.378443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.379131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.379415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.380180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.380413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:45.380720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.382096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.393435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.394804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:45.396462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:45.401095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 240/468] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:45.401771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.480006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 229/469] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:45.486435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.523215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59994c19-1193-4af5-82b3-1d4380999e4a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.569089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.570810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.571773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.572138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.572717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.573523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:45.573970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.576030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.594122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 241/470] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:45.595335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.616868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbca460-358d-41a3-8dab-7e09ab32a610 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.654832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.655884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.656360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.656796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.657664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.659278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.672849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.683173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 230/471] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:45 2022] POST /identity/v3/users => generated 248 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:45.684679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.752826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdbd92-0f62-4b52-ad6f-1bcde7cced8f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.812943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f0df2-7166-422c-a6fb-e88170057b82 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:45.834478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.835263 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:45.836319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.836639 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.836925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.859985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9853ae-9555-44bb-8ad9-c368fd24acd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:45.860616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.861250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9853ae-9555-44bb-8ad9-c368fd24acd2 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.861696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9853ae-9555-44bb-8ad9-c368fd24acd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.862100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.862321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9853ae-9555-44bb-8ad9-c368fd24acd2 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.863332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9853ae-9555-44bb-8ad9-c368fd24acd2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:45.864943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9853ae-9555-44bb-8ad9-c368fd24acd2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:45.893739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:45.894688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:45.896089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:45.896089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:45.896089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:45.896089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:45.896310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 231/473] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:45 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:45.896379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 242/473] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:45.904137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b39-aac0-48c6-9238-1cc7d931cbaa None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.904137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b39-aac0-48c6-9238-1cc7d931cbaa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.904379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c46b39-aac0-48c6-9238-1cc7d931cbaa None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.906076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 232/474] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:45.907800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:45.913874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:45.914245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:45.914455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:45.941126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:45.943425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:46.033965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb81468-8c21-4ea1-9948-c30edf55e9d4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:46.040156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 233/475] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:46.055608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:46.067003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:46.088356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:46.088356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:46.088356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:46.088356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:46.088753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:46.088753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:46.090804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:46.104236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 243/476] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:46.109971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:46.188452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d6fc-0a3b-41a2-96b1-9ac2bdefa23c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:46.191616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:46.235360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:46.236034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:46.236312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:46.236582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:46.237324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:46.238855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:46.247497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.sql.core [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 09:44:46.247497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 09:44:46.247497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [parameters: {'id': '6cd9e41ac491439887b7977939a65af3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 09:44:46.247497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80223) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 09:44:46.249760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b735-f957-4d8f-bbf6-655ad7251024 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 13 09:44:46.266987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return ref.to_dict() Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 09:44:46.267916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application yield resource Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise self.value Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application session.commit() Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 09:44:46.268840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.flush() Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application compat.raise_( Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 09:44:46.269811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 09:44:46.270694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 09:44:46.271538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [parameters: {'id': '6cd9e41ac491439887b7977939a65af3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:46.272312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 13 09:44:46.273107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:46.277102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 234/477] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 09:44:46 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:46.283149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:46.292457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:46.293544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:46.293830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:46.294106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:46.294913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:46.296974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:46.324845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 244/478] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:46 2022] POST /identity/v3/users => generated 249 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:46.423930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757974d6-82b4-4016-9872-8cf094351aa8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:46.466078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65128ba-41d2-496a-aa61-1fcfb5eec0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:46.466931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65128ba-41d2-496a-aa61-1fcfb5eec0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:46.467211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65128ba-41d2-496a-aa61-1fcfb5eec0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:46.467485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65128ba-41d2-496a-aa61-1fcfb5eec0d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:46.488545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65128ba-41d2-496a-aa61-1fcfb5eec0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c65128ba-41d2-496a-aa61-1fcfb5eec0d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:46.496747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:46.497632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:46.498899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 235/479] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:44:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:46.505601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:46.547861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:46.642959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b89953-8275-4b75-9fdc-d3d077d6c235 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:46.694366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:46.695104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:46.695380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:46.695650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:46.696401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:46.696703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:46.698075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00efb179-b566-4017-9d40-e3c1dbac7d51 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:46.707800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 245/480] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:47.604539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f0c4-6df2-424e-97db-8e36b86bd590 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:47.605129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f0c4-6df2-424e-97db-8e36b86bd590 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:47.605213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16f0c4-6df2-424e-97db-8e36b86bd590 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:47.607060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 236/481] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:47.612045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:47.612435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:47.612641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:47.635510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:47.637196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:47.707674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 246/482] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:47.741173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16f0c4-6df2-424e-97db-8e36b86bd590 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:47.781827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:47.874541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16f0c4-6df2-424e-97db-8e36b86bd590 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:47.919407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:47.920138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:47.920422 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:47.920698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:47.939275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:47.947063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:47.947946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:47.948743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:47.949945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 237/483] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:47.954570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:47.986376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:48.099245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b07a2f-6a1c-4640-9274-1f499f13eea8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:48.142006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:48.142753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.143038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.143358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.144126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:48.144431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:48.145829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5dbe6-1646-462d-85a4-f5a43d755cf4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:48.155279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 247/484] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:48.160903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:48.305493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:48.319352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fa951a-80d9-47ee-8679-61599e8ec1b9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:48.376834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:48.377651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.377943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.378210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.395984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:48.397343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03c30-3fcd-4241-8a21-f3e0e85cae46 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.397454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:48.397952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03c30-3fcd-4241-8a21-f3e0e85cae46 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.398610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a03c30-3fcd-4241-8a21-f3e0e85cae46 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.400429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 248/485] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:48.419715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:48.420602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:48.421441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:48.421441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:48.421441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:48.421441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:48.422124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 238/486] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:48.423297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f37c-8205-400e-8d5c-92c3475ce287 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.423791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f37c-8205-400e-8d5c-92c3475ce287 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.424258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f37c-8205-400e-8d5c-92c3475ce287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.426957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:48.456387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-54e9f37c-8205-400e-8d5c-92c3475ce287 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:48.458969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-54e9f37c-8205-400e-8d5c-92c3475ce287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:48.552934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 249/487] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:48.554379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680175-9f70-48ee-9f4e-6e67e8b9d57c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.554695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680175-9f70-48ee-9f4e-6e67e8b9d57c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.555414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9680175-9f70-48ee-9f4e-6e67e8b9d57c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.556995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 250/488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:48.562083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.562365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.562683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.569698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3ea8b-720f-42af-bb5f-232f1cecc7fd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:48.579340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:48.580497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:48.588326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:48.611174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:48.611842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.612123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.612392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.613267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:48.613574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:48.615639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:48.627042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:48.632537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 239/489] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:48.633600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:48.662235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 251/490] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:48.671382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:48.770112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2316d9-b5f5-4379-8136-e9985212f716 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:48.796364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac004-96e0-48a4-8255-974acc41a7cc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:48.817198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:48.817919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.818195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.818489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.833717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:48.834017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:48.835075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:48.835508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:48.835916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:48.842700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:48.843775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:48.844660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 240/491] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:48.845360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:48.846910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:48.848533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:48.866186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:48.867168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:44:48.868055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:48.869953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 252/492] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:44:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:48.871231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:48.874308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:48.922410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:48.980845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b9fc47-d1ab-4068-9362-f19f20755736 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:48.981819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07650a99-cda5-4d3b-a9ee-67cc3ea6a0a9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.017526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.018533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.019060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.019640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.020592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:49.021074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.022647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.028389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.029718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.030004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.030277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.033224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 253/493] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:49.034251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.046597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:49.056656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:49.057643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:49.058882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:49.062583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 241/494] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:49.065475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.107888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.151699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c718e40-e5aa-48ef-b4ee-2f23ec87ebbf None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.187784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.188847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.189435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.189790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.190648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:49.190953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.192143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb8f36-c9c5-4758-8d9a-5570129da533 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.192391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.213554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.227914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.228703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.228979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.229247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.232946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 254/495] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:49.233777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.240199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.241724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b44792e7-8235-48e7-8919-e2a06ffd37c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:49.259012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:49.260018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:49.260866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:49.260866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:49.260866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:49.260866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:49.260866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 242/496] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:49.261519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075129ce-8ee7-47d9-bfef-4161aa82f4cf None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.261805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075129ce-8ee7-47d9-bfef-4161aa82f4cf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.262081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075129ce-8ee7-47d9-bfef-4161aa82f4cf None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.263674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 243/497] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:49.264717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5a1fb-46cf-473d-820c-8c42dcb5b63e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.265057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5a1fb-46cf-473d-820c-8c42dcb5b63e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.265336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5a1fb-46cf-473d-820c-8c42dcb5b63e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.267176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 244/498] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:49.267817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5a1fb-46cf-473d-820c-8c42dcb5b63e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.361327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7bbbf-e6bb-42e5-a10c-3c29562c7ae4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.386598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5a1fb-46cf-473d-820c-8c42dcb5b63e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.388751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.406525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.407208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.407488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.407763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.408512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:49.408842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.410224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.420922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 255/499] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:49.420922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.434211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be473aec-0281-42be-8730-09e7ab137063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.435072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473aec-0281-42be-8730-09e7ab137063 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.435362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473aec-0281-42be-8730-09e7ab137063 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.435639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be473aec-0281-42be-8730-09e7ab137063 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.482845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.510916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be473aec-0281-42be-8730-09e7ab137063 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.512418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be473aec-0281-42be-8730-09e7ab137063 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.527789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6c5f6-8b2f-4986-86a0-1a740527bc84 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.567199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.568357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.569175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.569904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.570995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:49.571983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.573375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14c7a8-e0e1-4c16-beb7-71ddb633c828 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.587323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 256/500] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:49.588688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.589033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.589314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.606729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:49.607908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:49.621195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 245/501] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:49.622732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.623021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.623301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.641458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:49.642689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:49.655394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.682904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 257/502] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:49.683905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.729771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 246/503] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:49.730689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.732910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.789939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69395-17f8-4e6c-9b7c-8cd5ba75a08a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.824730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.825519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.825798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.826071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.836322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.837790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.837966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2a7f15-4645-44bf-837b-87b065868482 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:49.855924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:49.856833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:49.857681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:49.857681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:49.857681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:49.857681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:49.857681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 258/504] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:49.857946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.872626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.873345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.873622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.873890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:49.881162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:49.882634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:49.888493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:49.899066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:49.899987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:49.900891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 247/505] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:49.901448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:49.961522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b1b393-1b20-4c87-a46d-c876523c1d2a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:49.962773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:49.996214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:49.997024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:49.997310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:49.997583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.005517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25381b0e-7fe0-44d0-8f2f-4e3ae89884a0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.008979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.010494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:50.031796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:50.032709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:50.033585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:50.033585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:50.033585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:50.033585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:50.034594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 259/506] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:50.035687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.041105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.041898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.042181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.042799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.053324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.054838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:50.074682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:50.075607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:50.076439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:50.076439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:50.076439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:50.076439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:50.076439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 248/507] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:50.076707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.119759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.142964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b4e578-dd7f-41b7-9e24-6fb845fd20c2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.175841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.176635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.176736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05159221-4495-4411-8b84-0f82f8e5107e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.176920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.177193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.187458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:50.191761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:50.195079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:50.195963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:50.196792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 260/508] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:50.197451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.215951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.216616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.216896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.217168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.217892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:50.218198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.219587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.231470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 249/509] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:50.232204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.301188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7baba-b12a-49dd-82e7-3f239c41e13f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.334906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fc9da-ae34-4fc2-84cc-c1afecc3788d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.335767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.336432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.336709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.336978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.337816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:50.338116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.339692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.348507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.359029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 261/510] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:50.359854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.371826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.372501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.372785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.373062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.373795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:50.374099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.375527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.388030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 250/511] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:50.389125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.426466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.461979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc938c9-f691-4a10-881b-c7c1649c786e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.490934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb99e3c-3388-4f7c-b80d-aea4df29e396 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.495405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.496151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.496433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.496707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.497435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:50.497740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.499161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.510370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 262/512] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:50.511175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.529439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.530105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.530389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.530693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.531458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:50.531738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.533105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.545608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 251/513] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:50.545608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.571910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.616919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483eff1-096d-492e-b7a2-9da8064e4b83 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.634921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.642315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4650c-36c2-4d99-b735-b47895d339dd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.650782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.651575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.652059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.652352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.660453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.661913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.675728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:50.675874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:50.676750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 09:44:50.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:50.678170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.678170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.678170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.678356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 263/514] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:50.678356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.747573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.749028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.777327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd40c6-2e9d-44a7-917d-89d316a66faa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.793018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.810853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.811669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.811954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.812230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.818931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.820358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:50.835407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:50.836278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:50.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 264/515] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:50.838019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.845730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:50.857890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 252/516] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:50.857890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:50.940577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aefa7-e5a2-455a-99dc-12d654925c37 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.954430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d438d8d-3a6f-416e-ab97-91c25a5ac7ed None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:50.975355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.976169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.976453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.976729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:50.977436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:50.978916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:50.988555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:50.989351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:50.989624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:50.989901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.000259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 265/517] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:44:50 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:44:51.000585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.001079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.002096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:51.030216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:51.031206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:51.032076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:51.032076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:51.032076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:51.032076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:51.032076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 253/518] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:51.032332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.044677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.095463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.122281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909cc44-c019-4a19-a743-d774ee96fe19 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.156560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfee7d-e735-44c7-a345-7c2242710178 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.162841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.163521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.163807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.164086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.165425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:51.165658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.167675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.189890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 266/519] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:51.190846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.202886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.203560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.203849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.204124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.204923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:51.205240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.206707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.227407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 254/520] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:51.228595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.293844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.306110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56455772-57e7-43a8-8b61-dfd45332db77 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.332440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ace56-b91b-46bd-a8ed-309c4d4977ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.342912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.343271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.344281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.344386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.344644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.356233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.357717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.379479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.380152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.380435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:51.380542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:51.381291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:51.382123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:51.382123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:51.382123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:51.382123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:51.382326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.382326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:51.382326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.383112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.386380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 267/521] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:51.387425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.401583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 255/522] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:51.401583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.497325 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc7e9e-9481-4e59-9954-978c5bae447a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.507375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d5ffa6-01a0-4e4a-a558-f01770c48440 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.533120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.533763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.534045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.534304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.546518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.547339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.548224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.548523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.548798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.550211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=339f9bc083674bf897023509101fc7dc) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:51.550554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.552216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.566799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 256/523] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/role_assignments?user.id=339f9bc083674bf897023509101fc7dc&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:51.566799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.603929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.620045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.621738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.699013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb8ec3-cb91-4a52-a23a-92a55b78089d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.743468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.745064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.746248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.746583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.747767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:51.748040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.749447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.753960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 268/524] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:51.754631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.770655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 257/525] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:51.771621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.803045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.863954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497909-9565-4015-805b-7a9985ccf632 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.874840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14e9c67-447a-4c4a-8ab3-1b7e182e1320 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:51.878817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:51.900399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.901566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.902140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.902635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.910915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:51.911505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.911713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:51.911998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:51.912276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:51.913884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.923778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:51.925257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:51.929998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:51.930924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 09:44:51.931819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:51.934517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 269/526] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:51.935593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:51.944227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:51.945110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:51.946625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:51.946625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:51.946625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:51.946625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:51.946625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 258/527] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:51.946625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.042907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2069c4f-ea10-4662-8611-14cda8a1b7e7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.044984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.054389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c65fa-fec7-434c-8636-aff6b79ddacd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.081771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.084181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.084666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.085154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.093256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.093890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.094016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.094197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.094502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.095345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:52.095653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.096493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.097076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:52.111953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:52.112924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:52.113777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:52.116364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 270/528] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:52.117469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.137276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 259/529] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 13 09:44:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:52.138541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.141327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.248194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b499deb-32ca-4fb9-bf51-6562a070b260 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.249489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12462a-1dc4-4be7-bbed-3462252a5ff8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.283975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.284885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.285303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.285708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.286597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:52.287062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.287169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.287848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.288133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.288412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.289127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.289236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:52.289499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.291068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.306823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 271/531] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:52.307967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.309528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 260/531] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:52.310467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.335206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.384492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.418909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a4f38-e485-4955-9a0e-bc91b365f6a7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.426095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c39c8-f6f3-4dde-90b9-6894f710de69 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.455365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.456215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.456752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.457161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.462270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.462954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.463238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.463514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.464437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=50bda80f77ff46908f3011622beb3e19) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:52.464778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.466226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.478762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 261/532] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/role_assignments?user.id=50bda80f77ff46908f3011622beb3e19&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:52.479765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.532595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.534602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.562898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.646157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 272/533] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:52.656187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.702958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95621b9e-ca0d-4bf1-8cd1-71698e2b12c6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.747213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.775121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.775929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.776206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.776476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.786040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.786040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.796033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94c636c-cfb7-4247-aae0-94ef74ad4f94 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:52.811494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:52.812560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:52.813634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:52.819444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 262/534] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:52.827438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:52.846441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:52.849368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:52.850301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:52.850722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:52.851237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:52.863892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:52.865967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:52.885255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:52.886514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:52.887597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:52.887597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:52.887597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:52.887597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:52.893331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 273/535] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:52.894489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.003495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874b1ad-6fb7-48aa-8bf1-245e525d4236 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.033311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82944524-5876-4a7a-8ae4-7deb44af9c41 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.039102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.039766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.040044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.040312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.041094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:53.041396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.043172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.057578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 274/536] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:53.062901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.104060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:53.135147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.135834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.136124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.136477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.137309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:53.137595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.139396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.169026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 263/537] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:53.184495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66647a-873e-4ac0-98df-fda0ae124692 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.187591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.234589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.235997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.236282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.236607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.245861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.248047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.252653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-68695d89-b1e3-412b-be2b-d03a04252c3c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:53.269616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:53.270552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:53.271504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 275/538] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:53.274502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dbde1-17f6-4555-b25a-47361190d50f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.274502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dbde1-17f6-4555-b25a-47361190d50f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.274502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dbde1-17f6-4555-b25a-47361190d50f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.274502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 276/539] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:53.277349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dbde1-17f6-4555-b25a-47361190d50f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.320357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79a4d2-106e-4e6f-9fb7-3109cecf9748 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.356354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.357006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.357351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.357697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.358623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=2947dfd2c2b14daf9c16e534b0139da5) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:53.358997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.360505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a949e1-d794-4328-9a36-d793a50d6be8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.373601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 264/540] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/role_assignments?user.id=2947dfd2c2b14daf9c16e534b0139da5&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:53.375069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.375354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.375632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.418622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:53.421136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:53.442811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:53.463299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dbde1-17f6-4555-b25a-47361190d50f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.511317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 265/541] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:53.539327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.540019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.540294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.540572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.541376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:53.541680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.543285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.561519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.572788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 277/542] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:53.578781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.612469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:53.679237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139058ba-969a-42ff-bfdf-1f74042d645f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.717597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e5967-b6fd-4d26-b3db-5b15d1e9c55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.720540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5967-b6fd-4d26-b3db-5b15d1e9c55f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.721292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5967-b6fd-4d26-b3db-5b15d1e9c55f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.722461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e5967-b6fd-4d26-b3db-5b15d1e9c55f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.729504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1db39a-2f54-42d9-b2d0-c7b16bad6d52 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.738317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e5967-b6fd-4d26-b3db-5b15d1e9c55f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e62e5967-b6fd-4d26-b3db-5b15d1e9c55f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:53.746216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:53.747319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:53.748115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 266/543] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:53.749826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258004f2-f3e3-4804-b690-9a916e301660 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.750330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258004f2-f3e3-4804-b690-9a916e301660 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.750733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258004f2-f3e3-4804-b690-9a916e301660 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.756209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 267/544] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:53.757081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258004f2-f3e3-4804-b690-9a916e301660 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:53.776763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.778450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.778908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.779347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.780346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=70b8ca3066c649469fd409cae3fe9627) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:53.780842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.783150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb17ed6-388a-40b7-9431-6107a403d7b6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.791739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 278/545] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/role_assignments?user.id=70b8ca3066c649469fd409cae3fe9627&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:53.793802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.794243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.794703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.825282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:53.828310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:53.857155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:53.905661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:53.908489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258004f2-f3e3-4804-b690-9a916e301660 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:53.971038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:53.971716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:53.971998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:53.972276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:53.973066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 279/546] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:53.974508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:53.974867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:53.976261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:53.985419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 268/547] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:53.990984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.012746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.173616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4fbcf-f40c-47a9-bd5b-b99454c0d83a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.194704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f48aa4-f957-4108-a154-85de796de174 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.237635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.239127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.239408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.239679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.260813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.261720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.262021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.262272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.268669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:54.270160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:54.273829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:54.282012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:54.282954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:54.283731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 269/548] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:44:54.289494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.292315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:54.302815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:54.303899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:54.305762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:54.305762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:54.305762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:54.305762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:54.305762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 280/549] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:54.311383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.332465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:54.468777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b55d5-bf02-43d3-b929-a31ad24c22ed None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.506205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.507054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.507727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.508097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.509029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:54.509431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:54.511058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:54.521127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 270/550] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:54.527467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.528344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be685168-2501-47d3-99fc-d34e24a441c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.567356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.568024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.568301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.568572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.569291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:54.569593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:54.570997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:54.603390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 281/551] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:54.608878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.702895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:54.728481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:54.731102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e83e8-8d16-4deb-9858-007c25f45108 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.765774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.766540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.766825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.767100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.774495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a1415-62b4-44eb-931d-4b0c965f1e99 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.778149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:54.779652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e7a6380b-0c37-4abc-80a2-e4b1774deeb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:54.797073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:54.797972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:54.799011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:54.799011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:54.799011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:54.799011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:54.802555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 271/552] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:54.803896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1e770-e303-4121-a25f-f47df09ca55c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.804184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1e770-e303-4121-a25f-f47df09ca55c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.804464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1e770-e303-4121-a25f-f47df09ca55c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.810523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 272/553] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:54.811337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1e770-e303-4121-a25f-f47df09ca55c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.819661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.820463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.820746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.821019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.833314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:54.834983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-8f4fe6f0-c309-4501-8e4b-dd4f3abde902 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:54.851520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:54.852511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:54.853423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 282/554] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:54.859546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.860202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.860202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.879496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:54.880847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:54.937405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1e770-e303-4121-a25f-f47df09ca55c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:54.974441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 283/555] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:54.974441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:54.989662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:54.990696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:54.991189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:54.991652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:54.992565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:54.993134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:54.994783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.004266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.020084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 273/556] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:55.020939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.027919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.094466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06782c04-2d07-4910-9320-ee05662739b8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.131088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc574215-7a61-49fa-8a76-a43731c7a496 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.139964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.140911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.141418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.142271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.143706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:55.144483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.146832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.167173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.168125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.168405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.168676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.172286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 284/557] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 09:44:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:55.173298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.183961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:55.191621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:55.193062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:55.193894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:55.197644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 274/558] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:55.198518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.267954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.289562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa64fb5-194e-4c04-a552-819382fc77f2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.299720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.329109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f3512-b2c1-4d71-8b22-ffd0598a0a8b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.329973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.331274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.332626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.333114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.342870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.345300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:55.365008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:55.366015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:44:55.367050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:55.369657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 285/559] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:55.370703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.377065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.377775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.378065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.378336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.453811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.455309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.512812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6bae8f-98a9-4221-9876-649964e7abd4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.514941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.561069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.562272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.562785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.563267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.564247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:55.564745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.566382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.568863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 275/560] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:44:55.569807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.577613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 286/561] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:55.578760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.617515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.682730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7298c85a-aec3-4103-8453-8cd8be3cd8fd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.713806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6979a-43cc-4790-a76a-a1f53b93e753 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.718213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.719037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.719420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.719782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.720706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:55.721105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.722656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.742591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 276/562] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:55.743640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.758052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.759164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.759603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.760259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.761558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.778295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.779771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:55.799992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:55.800921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:55.801800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:55.801800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:55.801800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:55.801800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:55.805740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 287/563] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:55.806362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.866218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf43fd4-516d-4208-bc95-ae400916b77d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.891557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:55.904005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.904831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.905353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.905353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.911114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad6ff46-faf8-4afc-9519-ac6e35105e11 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:55.915921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.917395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9fd7957d-3d43-422c-b201-651847609c1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:55.935154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:55.936059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:55.936961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:55.936961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:55.936961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:55.936961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:55.936961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 277/564] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:55.937651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedcd12-f5eb-4863-9df2-53101bc4e5f5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.937933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedcd12-f5eb-4863-9df2-53101bc4e5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.938208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bedcd12-f5eb-4863-9df2-53101bc4e5f5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.939513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 278/565] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:55.940203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedcd12-f5eb-4863-9df2-53101bc4e5f5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:55.952333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:55.953133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.953414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.953681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.963907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:55.965443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d455603e-c5b7-4a4a-931f-7b4547dd83a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:55.983864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:55.984760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:55.985641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:55.985641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:55.985641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:55.985641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:55.986091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 288/566] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:55.987541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16145a8-92d8-45b3-98c8-467adb257d38 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:55.987826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16145a8-92d8-45b3-98c8-467adb257d38 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:55.988112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16145a8-92d8-45b3-98c8-467adb257d38 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:55.989527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 289/567] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:55.991224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16145a8-92d8-45b3-98c8-467adb257d38 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.007827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.045561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bedcd12-f5eb-4863-9df2-53101bc4e5f5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.080069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.080729 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.081005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.081275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.081985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:56.082293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.083678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc41224-6bfd-4ea0-a132-0ad7fca0b2a3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.093595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16145a8-92d8-45b3-98c8-467adb257d38 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.095437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 279/568] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:56.096766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd903-cf1d-4c49-a9dd-d0b7b260f469 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.097059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd903-cf1d-4c49-a9dd-d0b7b260f469 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.097336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8dd903-cf1d-4c49-a9dd-d0b7b260f469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.114250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ec8dd903-cf1d-4c49-a9dd-d0b7b260f469 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:56.115997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ec8dd903-cf1d-4c49-a9dd-d0b7b260f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:56.127905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.128539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.128824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.129101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.129821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:56.130128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.131534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.133107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.143764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 290/569] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:56.144568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.188847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 280/570] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:56.190126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.190725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.190725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.215037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:56.216211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:56.243493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e17f40-976d-4f83-8f3d-1de23cd618d1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.265046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.278738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.279401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.279678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.279946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.280654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:56.280954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.282124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 281/571] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:44:56.282310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.282971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.299348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 291/572] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:56.300226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.353808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.387834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd6540-f81f-41ba-99fc-a72f7a4d7e1d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.403028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4590da-d0ee-4cee-8e89-147f9b46c94c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.423911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.424704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.424985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.425263 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.432773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.434280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.435859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.436645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.436923 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.437193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.444479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.445886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:56.447896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:56.449330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 282/573] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:56.450519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:56.463547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:56.464785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:56.465784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 292/574] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:56.466389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.501756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.555919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739c108-df3f-4e80-95f4-80a15a823178 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.564655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4993ad1-d377-4fef-8cd5-4eb8a4ff5f8c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.578168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.589761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.590496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.590779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.591051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.597946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.598747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.599021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.599287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.601219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:56.606135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.607611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:56.609458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:56.610570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 283/575] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:56.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:56.625174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:56.626187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 293/576] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:56.631919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.713842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d369072c-283d-4a01-94dd-1d82ffdcf166 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.720693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.730197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aebfd91-5285-46d0-892f-f58c2121089e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.749718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.750548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.750842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.751119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.761529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:56.764533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.765180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.765455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.765723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.766524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:56.766828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.768264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:56.769539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:56.770486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:56.771382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 284/577] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:56.772061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.784109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 294/578] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:56.784929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.820191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:56.875607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d7560-d67b-4312-9f3f-084a3860e6d0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.885438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3cd83f-7a7c-44c5-8eee-53b1da4d4f91 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:56.909266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.909925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.910210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.910489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.911479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:56.911612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.913022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.918792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:56.919456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:56.919743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:56.920020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:56.920763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:56.921070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:56.922466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:56.930013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 285/579] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:56.934908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 295/580] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:56.935068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.935175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:56.958346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.029547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.033807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a53bbc-cd68-4253-a7d7-d72561c40f7e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.035969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb063e0-784f-44a8-8689-4990ec26dbc5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.068788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.069449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.069732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.070005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.070816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:57.071048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.071171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.071719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.072003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.072277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.072547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.073020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:57.073324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.074714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.083010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 296/581] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:57.083795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.090821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 286/582] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:57.091532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.175306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.186068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5b9f4-d68f-464b-a672-398f3a844840 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.193450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8e8c9f-09eb-48e6-8f31-4b860c5ebfb1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.222592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.223251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.223531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.223794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.224613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ad683d737d594402850ef0af27d6e103) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:57.224924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.226385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.229403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.230264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.230750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.231030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.232426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 297/583] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/role_assignments?user.id=ad683d737d594402850ef0af27d6e103&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:57.233201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.242799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.244255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:57.265134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:57.266107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:57.267642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:57.267642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:57.267642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:57.267642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:57.267642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 287/584] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:57.267939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.278361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.365589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48af9c-3f17-41f1-be3b-d3452e1d103a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.397741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b45a963-5efd-4b82-9699-faf158a028b7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.404049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.404847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.405123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.405396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.417083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.418810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.433579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.434253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.434570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.434851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.437575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:57.438045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:57.438940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:57.439816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:57.439816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:57.439816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:57.439816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:57.439816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 298/585] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:57.440089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.451329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.453140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:57.471701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:57.472633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:57.473519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:57.473519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:57.473519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:57.473519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:57.473519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 288/586] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:57.473810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.525169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.552596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199f3068-3c00-47e5-b822-f9b01bc16c07 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.584129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538fe6ab-e274-4782-91a8-cbf044d7e74d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.588222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.589139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.589548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.589715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/339f9bc083674bf897023509101fc7dc/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.604252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=339f9bc083674bf897023509101fc7dc, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.606290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.620156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.630683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 299/587] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:57 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/339f9bc083674bf897023509101fc7dc/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:57.630897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.630897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.630897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.631160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.631245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:57.631245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.631245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.647323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 289/588] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:57.648306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.714839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.778787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf0cb9f-ca4a-4d5a-afc6-310963a15072 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.779600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa846788-3265-43f5-a7f8-6e48fd5a6128 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.811749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:57.827050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.827812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.828090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.828355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.829073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:57.830008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.832035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.837695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.838381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.838719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.838998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:57.840514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:57.840828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:57.842235 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:57.847149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 300/589] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:57.849355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.856160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 290/590] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:57.858169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:57.960628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188f763-ea01-4849-8470-51fa0b37d36f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.991634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1c736-5962-4d1d-bc4e-34408fb26056 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:57.996514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:57.997413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:57.997760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:57.998098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.003106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.005701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.007677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:58.026023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:58.027097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:58.027988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:58.030748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 301/591] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:58.031691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.039045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.039983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.040423 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.040793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.049554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.051259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:58.066499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:58.067559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:58.068494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 291/592] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:44:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:58.069681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.112110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.167360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231011a-1e1e-41fc-8a21-88caf7eeee8f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.201914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f040d8a4-de04-4311-92ab-9ac8b9f2e496 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.206144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.207081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.207450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.207810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.218528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.220516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.238640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.239524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:44:58.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:58.240691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 09:44:58.241632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:58.242879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.243308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.244249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:58.244711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.245998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 302/593] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:58.246929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.247054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.261200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 292/594] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:58.262297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.295618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.384136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b655bdc-2e8e-43bf-ad7c-cbd271b195f2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.385202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910641-1abf-414b-ad7c-5b1ec40c2bd8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.389527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.425306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.426231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.426718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.427132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.428102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:58.428343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.428715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.429012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.429287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.429556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.430385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:58.430733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.431114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.432198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.451738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 303/595] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:58.452937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.458380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 293/596] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:58.459159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.553256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.570577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94280ea-0298-4342-8ccc-256286aa4cbc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.584895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4075812-42b9-4f6b-8cdd-fa04de7f47b9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.614274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.615472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.615755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.616054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.620052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.621279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.621724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.622137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/50bda80f77ff46908f3011622beb3e19/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.628798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.630233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.637589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=50bda80f77ff46908f3011622beb3e19, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.639621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:58.653305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:58.654481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:58.655929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:58.655929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:58.655929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:58.655929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:58.655929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 294/597] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:58.655929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.657346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 304/598] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:58 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/50bda80f77ff46908f3011622beb3e19/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:58.668739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.699077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.859314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd5c0-893d-4512-965b-206706cc8269 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.869310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8431b3-2aa2-478c-a777-b1c11305b4e8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:58.898371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.899246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.899533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.899809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.907193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:58.907375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:58.908164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:58.908584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:58.909009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:58.909879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:58.910368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.911911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.912174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:58.913625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:58.925188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 305/599] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:58.931453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:44:58.934271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:58.935353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:58.936447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:44:58.936447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:44:58.936447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:44:58.936447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:58.938583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 295/600] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:58.941230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.053998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674613ce-0b46-4af0-b26c-b2fff3ce5ec7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.094654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:59.095632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.096306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.096588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.096858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.097586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:59.097892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.099291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.114970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 296/601] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:44:59.121253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.158168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c236a-48eb-4a33-a35e-780cd97d1a41 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.194868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.195656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.195932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.196202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.205301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.206774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:59.222689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:59.223638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:59.224520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:59.225487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 306/602] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:59.230477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.231195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:59.290453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e3ed0-b6d4-4ee2-a2d2-c6b95c4ba735 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.330753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.331550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.331828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.332100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.339351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.341195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f9f778c1-b5f1-4692-99b7-5777d505a56c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:44:59.356568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:59.358668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 297/603] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:44:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae792-4892-4854-afba-6f7984a3f6a1 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.360478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae792-4892-4854-afba-6f7984a3f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.362706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae792-4892-4854-afba-6f7984a3f6a1 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.362706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 298/604] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:44:59.376485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.376485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.376485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.384596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14687d-f5ec-474d-be4c-8a784ff1006a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.395119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:59.396681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:59.415443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:59.420562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.421642 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.422294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.422684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.423613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:59.424033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.425552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.438988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 307/605] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:59.440593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.475570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 299/606] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:44:59.476907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.522057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:59.545500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fb285-75fa-4ca1-9a2f-1c446a00e3ab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.580868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.581742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.582114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.582543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.583465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:44:59.583945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.585532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.586269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd476a-a2a5-43ea-a1ad-c3c9ceae0253 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.599239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 308/607] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:44:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:44:59.600354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.628998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.630210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.630698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.631110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/2947dfd2c2b14daf9c16e534b0139da5/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.648278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=2947dfd2c2b14daf9c16e534b0139da5, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.650146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.656538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:59.669892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 300/608] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:59 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/2947dfd2c2b14daf9c16e534b0139da5/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:59.671523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.712458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e79a8-e764-43df-982b-20a7ddc432ed None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.751307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.752411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.752861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.753263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.766342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:44:59.774665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:44:59.775872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:44:59.776968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:44:59.779511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 309/609] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:44:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:44:59.787543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:44:59.798854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:44:59.814212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c332c75-cae4-45b8-b2f4-05f0bd61aa90 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.888686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee885c6f-fce8-4c90-b99d-9bb985e8b2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:44:59.889865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee885c6f-fce8-4c90-b99d-9bb985e8b2b7 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.890207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee885c6f-fce8-4c90-b99d-9bb985e8b2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.890568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee885c6f-fce8-4c90-b99d-9bb985e8b2b7 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/70b8ca3066c649469fd409cae3fe9627/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.910827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee885c6f-fce8-4c90-b99d-9bb985e8b2b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=70b8ca3066c649469fd409cae3fe9627, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:44:59.912691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee885c6f-fce8-4c90-b99d-9bb985e8b2b7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:44:59.930488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 301/610] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:44:59 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/70b8ca3066c649469fd409cae3fe9627/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:44:59.949656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699ad3-d99b-47ab-8f4d-c94838fc2765 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.950174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699ad3-d99b-47ab-8f4d-c94838fc2765 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.950587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11699ad3-d99b-47ab-8f4d-c94838fc2765 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.952424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 302/611] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:44:59.957936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:44:59.958319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:44:59.958713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:44:59.967428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e957fa89-9f1a-47e5-baca-63fe8411a60e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:44:59.976666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:44:59.978179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:44:59.983215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:00.007866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.008554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.008986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.009267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.010607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:00.010929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:00.014093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:00.024898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 310/612] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:44:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:00.032892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.058445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 303/613] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:44:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:00.082427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.162388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:00.196189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f1043-3011-4987-8b73-7d51a02af318 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.232958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.233764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.234043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.234316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.241930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35147537-52ea-4223-b1aa-ffe3c2305fa7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.254738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:00.262788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:00.264125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:00.264969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 304/614] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:00.275580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.298828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.299642 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.299926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.300195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.312500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:00.313966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:00.332781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:00.333703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:00.334640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:00.334640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:00.334640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:00.334640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:00.334640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 311/615] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:00.347466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.410768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:00.427361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1410d11-b81d-4d14-98e4-5bb8569fbb40 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.462162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.462868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.463149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.463425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.464205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:00.464514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:00.465885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:00.478675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 305/616] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:00.478836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:00.480141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.575805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f861d-21be-4923-b078-f16fa3234445 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.626286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236179f-7ae8-47e1-82e6-ca91814a2ead None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.650431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.651115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.651397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.651790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.652511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:00.652906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:00.654364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:00.674774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 312/617] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:00.680049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.681141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.681954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.682235 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.682536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.710278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:00.711786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:00.742367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:00.743343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:00.744254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:00.744254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:00.744254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:00.744254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:00.744254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 306/618] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:00.764087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:00.854598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:00.904889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:00.917228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83fb98f-0537-40f7-8c79-f3a9f896856f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.932363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d7d1b4-44c7-483e-8455-f0dd12b4c89c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:00.992788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:00.993463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:00.993746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:00.994027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:00.994768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:00.995079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:00.996556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.010248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.011126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.011408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.011680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.019861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.030731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.031474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 307/619] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:01.046310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:01.047260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:01.048428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:01.048972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.062144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 313/620] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:01.067855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.190470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46600a94-4d97-43b7-a49d-0758573b6626 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.232596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.233275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.233556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.233829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.237187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:01.237504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.238985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24bc09-e326-443a-a2a1-fa0a8f682fac None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.259848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 314/621] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:01.260615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b9d64-9d54-4b98-8d93-0b3a83ef08ba None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.261421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140f1c-dce6-4b3a-8022-a55cd1365005 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.261774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140f1c-dce6-4b3a-8022-a55cd1365005 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.262061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15140f1c-dce6-4b3a-8022-a55cd1365005 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.263524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:01.267818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 315/622] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:01.268641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15140f1c-dce6-4b3a-8022-a55cd1365005 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.295413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:01.298868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.299882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.300310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.300760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.308720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.310471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cd915557-cb08-4de4-a48d-a54239ad580a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:01.326027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:01.327275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:01.328251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:01.330777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 308/623] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:01.332294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.332767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.333216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.351519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:01.353054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:01.393380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15140f1c-dce6-4b3a-8022-a55cd1365005 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.427558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 309/624] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:01.428751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.451092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.452196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.452654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.453139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.467749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.469528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:01.488241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:01.489184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:01.490108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:01.490108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:01.490108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:01.490108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:01.492023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 316/625] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:01.493052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.557608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:01.560924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:01.566399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21d81a-b10a-4f10-8382-6c0da25ed0c8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.610083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c530-f7bf-486b-9e24-5a94c3e84f70 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.614665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.615353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.615637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.615915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.616750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:01.617062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.618505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.646499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 310/626] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:01.647728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.654160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.655292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.655799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.656271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.668600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:01.677176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:01.678111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:01.678996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:01.681880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 317/627] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:01.683123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.770645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5502-8b0c-4bab-9f17-a601232c79cb None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.809130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.810203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.810806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.811276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.812240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:01.812758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd826fe-3bb0-4a83-8ed2-cb336a29a85d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.812873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.814653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.827547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 311/628] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:01.828680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:01.833345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:01.847110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:01.853099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af5a50-4da4-43d6-b1b9-78f3375674f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.853761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af5a50-4da4-43d6-b1b9-78f3375674f6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.854041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af5a50-4da4-43d6-b1b9-78f3375674f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.854319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af5a50-4da4-43d6-b1b9-78f3375674f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.926696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af5a50-4da4-43d6-b1b9-78f3375674f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.928159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af5a50-4da4-43d6-b1b9-78f3375674f6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.944869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa8398-5b9f-4277-b284-4f0476b8c2de None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:01.982498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:01.983523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:01.984007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:01.984585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:01.985661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:01.986168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:01.987971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:01.997004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 312/629] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:01.998022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.040348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 318/630] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:45:02.040348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15df2-e759-46be-9fca-e4eb9ae715e1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.040348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15df2-e759-46be-9fca-e4eb9ae715e1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.040348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db15df2-e759-46be-9fca-e4eb9ae715e1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.040348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 319/631] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:02.040348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15df2-e759-46be-9fca-e4eb9ae715e1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.062348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.084587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.112870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ba955-b792-4a89-b102-13f3904494fc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.148935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.149733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.150019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.150295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.153315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db15df2-e759-46be-9fca-e4eb9ae715e1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.157803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.159264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:02.181685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:02.182690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:02.183833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:02.184755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 313/632] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:02.185289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.208087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.208890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.209172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.209440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.220954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.222410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-05d94668-69a8-4629-9a63-efcb26c1601a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:02.240711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:02.241637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:02.242548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:02.242548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:02.242548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:02.242548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:02.242548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 320/633] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:02.243197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.243486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.243761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.263455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:02.264688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:02.301998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e7470-67f6-4a89-b078-b2c1cb15f6c7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.327682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.333772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 321/634] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:02.338970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.339373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.340191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.340648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.341054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.343268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.353756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.355317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:02.375780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:02.376673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:02.377561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:02.377561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:02.377561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:02.377561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:02.377561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 314/635] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:02.377850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.441373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209d14e-70ad-4ece-9bb0-5c7b27cfccba None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.476748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.477405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.477681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.477949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.478684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2047cc-3de0-4490-bab6-735bd05a83c4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.478852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:02.479036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.480772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9210a50a-f151-4d56-9ed0-3e1d87ab1a92 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.492623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 322/636] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:02.493925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e12d0-c624-4dd9-a2c0-ac0e66182d4b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.494239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e12d0-c624-4dd9-a2c0-ac0e66182d4b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.494533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e12d0-c624-4dd9-a2c0-ac0e66182d4b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.495782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 323/637] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:02.496466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e12d0-c624-4dd9-a2c0-ac0e66182d4b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.519681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.520492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.520783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.521068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.521793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:02.522125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.523577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.535434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 315/638] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:02.536222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.555529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.584388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.601703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e12d0-c624-4dd9-a2c0-ac0e66182d4b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.635521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.636358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.636634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.636902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.637230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4c3f-7da5-4dc6-a064-c4366de452df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.647347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:02.655031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:02.656047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:02.656898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 324/639] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:02.657623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.674476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.675124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.675419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.675675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.676388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:02.676695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.678055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca994529-862a-4f41-a968-6fb2a844ba03 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.690170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 316/640] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:02.691364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.691644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.691913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.707882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:02.709073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:02.759784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ebab6-af1d-4c8a-aaa0-ddabd6534da9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.774530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 317/641] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:02.775356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.777626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.797453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.798355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.798668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.798940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ad683d737d594402850ef0af27d6e103/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.808758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:02.813670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=ad683d737d594402850ef0af27d6e103, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.815174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.827576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 325/642] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:02 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ad683d737d594402850ef0af27d6e103/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:45:02.828563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.891564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150044fd-0064-495a-841e-1b727cb5c89f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.934254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.935118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.935399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.935679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.943856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:02.945115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416d0f34-fdbb-4b8f-a446-72f357d4b689 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:02.945314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:02.962132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:02.963258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 318/643] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:02.964306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:02.996682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:02.997354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:02.997704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:02.997987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:02.998847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:02.999159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.000532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.010158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 326/644] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:03.011404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.044522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.075079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.081149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2915d64-e6ca-490e-b4cd-03d94c0cbe1a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.122008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.122844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.123054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5170e60f-8706-4722-bacf-4d98f982822b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.123158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.123390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.131803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.133918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:03.149013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:03.150082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:03.151211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 319/645] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:03.151920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.163510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.164655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.164962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.165215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.176041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:03.183925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:03.184835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:03.185670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 327/646] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:03.186367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.265035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26757f7a-8d9d-42e5-8b7a-bd1761983c1b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.288058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.298935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476173d-b7a1-4dee-afe4-88e5448f8e88 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.305016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.305692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.305970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.306248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.307111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:03.307419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.309379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.328861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 320/647] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:03.329453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.340341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.341391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.341840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.342305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.346030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.353794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.355444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:03.377899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:03.379001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:03.379914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:03.379914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:03.379914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:03.379914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:03.379914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 328/648] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:03.379914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.444050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db39090e-09bc-4b13-b794-d851c724644d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.481597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.482257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.482582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.482851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.483628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:03.483932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.485353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.489028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5cfbb4-6967-4a7f-a191-3bdfbf7eae4f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.497546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 321/649] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:03.498370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.529728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.530392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.530697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.531078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.531821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:03.532126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.534169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.543726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 329/650] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:03.544551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.551059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.585710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.611492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01151799-53bd-40e0-8d97-682ea5da8a24 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.648154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.648845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.649130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.649509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.653155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabb8ba-9246-40dd-8f3f-cb04356d3969 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.687311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.687979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.688245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.688543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.689260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:03.689565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.690961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.702850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 330/651] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:03.703637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.727403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.729332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.764628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.801744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea056-66c6-47b8-8d37-6cc8af0b0186 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.809179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:03.837309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:03.842759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 322/652] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:45:03.842902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:03.842902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:03.842902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:03.843154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.843250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=339f9bc083674bf897023509101fc7dc) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:03.843250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:03.843250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:03.848883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 331/653] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/role_assignments?user.id=339f9bc083674bf897023509101fc7dc&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:03.858465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:03.981160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f02d8-8db2-465a-90f9-f12c295df871 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:03.998037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fad01-46af-4a38-9e92-b756730327c5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.013827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.025781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.026907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.027780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.028197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.038333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.040082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.042968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.044446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.044726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.044998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.057645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.058400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:04.060496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:04.061505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 332/654] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:04.064348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:04.083406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:04.084355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:04.085256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:04.085256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:04.085256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:04.085256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:04.087230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 323/655] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:04.088330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.119029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.193044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb7ca9-70ea-4baf-a43c-807d504a9307 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.206441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3dbe0-d429-439d-9243-df4e4ed26f98 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.236638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.237735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.238132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.238562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.242002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.242733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.243009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.243280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.244108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:04.244409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.245988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.251089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.252536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.265013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 324/656] 10.222.0.17 () {56 vars in 1137 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:04.265842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:04.277224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:04.278262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:04.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:04.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:04.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:04.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:04.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 333/657] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:04.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.336616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.374811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.394289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd8a7-4929-4569-b9ec-9358462d5618 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.411145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f9c16d-bcef-4dfb-944e-35b486a23bd1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.442701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.444260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.444800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.445215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.446091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:04.446561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.448057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.450138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.451327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.451327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.451723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.467485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 325/658] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:04.467485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.548379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.550239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.586333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415de6a-507f-4420-8dc4-64efec907dbe None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.594168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.633690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.634908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.635390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.636124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.637548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:04.638605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.640400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.661033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 326/659] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:04.661033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.663462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.675513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 334/660] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:45:04.677052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.782521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f834a33-e96a-4338-aa9e-c1ce60d5d34d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.785061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db6456-df10-42fa-ba9a-bdedd3cbf73e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.825205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.825735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:04.826248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.826631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.826975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.827375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:04.827831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:04.828287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:04.834841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.836378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.837122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:04.839092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.839537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:04.855635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:04.856759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:04.857729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:04.858952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:04.859880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 13 09:45:04.860921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:04.862297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 335/661] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:04.862394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.863946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 327/662] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:04.868608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:04.932777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:04.973751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54531223-266f-4681-abee-8c1889e86e08 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:04.980495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c109c4-1ec9-4c04-8341-c767c9ba6583 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.009683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.010402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.010712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.011106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.011891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:05.012198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.013959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6f69b-1ee6-4157-aab4-74d853e3d033 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.014179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.014998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.015273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.015548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.025894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.026960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 328/663] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:05.027392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.028653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b5444-2cd5-41c2-bd91-248793cd770e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.028944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b5444-2cd5-41c2-bd91-248793cd770e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.029223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b5444-2cd5-41c2-bd91-248793cd770e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.030673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 329/664] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:05.035241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b5444-2cd5-41c2-bd91-248793cd770e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:05.049889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:05.051043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:05.051975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:05.051975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:05.051975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:05.051975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:05.051975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 336/665] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:05.052276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.107658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.158208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b5444-2cd5-41c2-bd91-248793cd770e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.161179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793296c7-60d5-49dc-8827-8d95ef072651 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.183009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.194659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.195342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.195621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.195893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.196778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:05.197086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.197257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.198077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.198564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.198787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.199146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.200116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=50bda80f77ff46908f3011622beb3e19) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:05.200588 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.202161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69319f08-ad92-4cdb-90c4-f878e635a2b6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.208607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 337/666] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/role_assignments?user.id=50bda80f77ff46908f3011622beb3e19&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:05.210010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.210291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.210599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.229693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:05.230059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 330/667] 10.222.0.17 () {56 vars in 1139 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:05.231033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:05.232210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.322811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 338/668] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:05.323960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.380595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13910d-e8e3-488c-a9c0-83d091f0dca3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.411684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.427547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.428407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.428914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.429108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.429925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:05.430297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.431752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.452726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 331/669] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:05.452726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.478808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c447c30-0f15-471f-a34b-8c27727e83ed None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.511073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.515554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.516356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.516704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.517049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.588018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320909b8-93dd-472c-9363-c0f71629413a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.591023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.592858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.627185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.627991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.628274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.628548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.645018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:05.653761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:05.654809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:05.655660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:05.658562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.659338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 332/670] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:05.660344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.731128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 339/671] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:45:05.731128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.777451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7f542c-b70f-4517-b792-a472c7cdb313 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.799582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.814594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.815660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.816039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.816411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.824382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.825961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.837385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef410d5-34da-4035-9c61-a78e74fdcd3f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:05.841609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:05.842593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:05.843638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 333/672] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:05.844822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.881732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:05.882696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:05.883051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:05.883651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:05.884758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:05.885117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:05.887126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:05.897757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 340/673] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:05.903517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:05.915352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:05.967415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e7620-c748-4d79-8cc9-1cc338b40a7e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.004740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.005960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.006484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.006958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.014654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b2735-f3a9-488d-8918-0b26eaf3f0f0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.019798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.021863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:06.042622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:06.043583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:06.044488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:06.044488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:06.044488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:06.044488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:06.050716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 334/674] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:06.051412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.055426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.056843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.056843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.056843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.057585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:06.057999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.059884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.070132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.073386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 341/675] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:06.076972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.145530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.159643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed24886-291a-4578-983b-1408bc83f0d4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.181709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a38064-3144-4b47-8008-2fd9db4b831a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.196314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.197231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.197625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.197905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.209131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.210529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.217749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.218409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.219113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.219394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.220111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:06.220797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.222169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-16c0649a-83c3-44af-b0bd-c5f304943f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:06.229257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:06.230312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:06.231593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:06.231593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:06.231593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:06.231593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:06.235504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 335/676] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:06.236575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238c57-e7d1-4deb-83c6-78d777f340a5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.236860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238c57-e7d1-4deb-83c6-78d777f340a5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.237133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3238c57-e7d1-4deb-83c6-78d777f340a5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.242575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 336/677] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:06.242575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238c57-e7d1-4deb-83c6-78d777f340a5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.242780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 342/678] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:06.242780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.312703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.346826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce59df-0c4c-4994-946c-4976a4513f92 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.351912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3238c57-e7d1-4deb-83c6-78d777f340a5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.377640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.386665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.387343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.387625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.387939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.388941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:06.389251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.390674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.395169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.395829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.396109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.396383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.397207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=2947dfd2c2b14daf9c16e534b0139da5) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:06.397518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.398967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac5f2-7ff5-4de7-9431-d55e2cc89098 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.404910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 343/679] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:06.406026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.414860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 337/680] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/role_assignments?user.id=2947dfd2c2b14daf9c16e534b0139da5&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:06.417115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.417465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.417841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.439634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:06.441391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:06.540184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 338/681] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:06.540184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.559765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a8f-d1ec-4aa6-b594-33a871be2b8a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.596592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.597971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.598840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.599445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.609039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.611055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.612406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:06.630061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:06.631071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:06.631992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:06.634544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 344/682] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:06.636444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.664392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3ef1f-d98c-4d6a-ac54-a9e92d37e05d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.689899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.705953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.707060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.707542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.707817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.715628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.717069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:06.731838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:06.732828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:06.733782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 339/683] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:06.734396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.750241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d11301-c94a-46aa-baa9-0840c043fec7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.787724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.788529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.788870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.789146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.801019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:06.809650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:06.810683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:06.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 345/684] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:06.812233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.847517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ed9f1-9309-4429-a9c7-79df47c5e81d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.869856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.890385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.891580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.892173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.892665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.893654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:06.894190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.896066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.910211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 340/685] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:06.911434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:06.931943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccee9dd-975c-4627-9ff9-eea300b855c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:06.941279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:06.968307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:06.968972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:06.969259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:06.969531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:06.970370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:06.970706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:06.972135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:06.991064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 346/686] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:06.991864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.029009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef5fa4-e368-4629-b55c-ebe32ac0b4b5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.068133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.069188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.069739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.070240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.071337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:07.071861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.073652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.083803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 341/687] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:07.084961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.096693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192cc4c-d43e-445b-b07d-42753d525981 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.132031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.132603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.133181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.133181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.133970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=70b8ca3066c649469fd409cae3fe9627) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:07.134277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.135341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:07.135751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.150814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 347/688] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:06 2022] GET /identity/v3/role_assignments?user.id=70b8ca3066c649469fd409cae3fe9627&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:07.152224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.205440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:07.207483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a92c-7c1e-4b32-8093-c038524ab0a0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.263507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8be4dae-bd19-4d87-9e3a-cd31bc830457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.264581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4dae-bd19-4d87-9e3a-cd31bc830457 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.265116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4dae-bd19-4d87-9e3a-cd31bc830457 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.265595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8be4dae-bd19-4d87-9e3a-cd31bc830457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.302878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb1e74-1cd9-4e19-9be6-e9c6231f64b4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.347128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.347948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.348227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.348501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.373155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.374695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:07.406285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:07.407255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:07.408177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:07.408177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:07.408177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:07.408177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:07.410268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 348/689] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:07.417917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be4dae-bd19-4d87-9e3a-cd31bc830457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.418697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.419523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8be4dae-bd19-4d87-9e3a-cd31bc830457 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.475176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:07.530857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:07.547827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 342/690] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:45:07.550203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c453-88fc-43a7-9bc4-afd49529a28b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.550641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c453-88fc-43a7-9bc4-afd49529a28b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.551019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5c453-88fc-43a7-9bc4-afd49529a28b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.554496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 343/691] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:07.555417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c453-88fc-43a7-9bc4-afd49529a28b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.560371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb6370d-4097-43e8-ba22-16bd599c8595 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.598237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.599293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.599777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.600351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.601323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:07.601844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.603617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72358fa-69f2-4fba-934d-6c00e7b091a7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.618046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 349/692] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:07.620036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.620591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.621192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.640323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:07.641984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:07.666303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5c453-88fc-43a7-9bc4-afd49529a28b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.702892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.703698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.704027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.704299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.715617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.717077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.719048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:07.726519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 350/693] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:07.727694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:07.738003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:07.739142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:07.740349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:07.740349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:07.740349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:07.740349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:07.740349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 344/694] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:07.747440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.828093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:07.868151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc6eab-5ff7-4788-8c5b-ad4dbbf19521 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.883682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7487f208-b69d-4ad2-bc25-8865b6dd63e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:07.905170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.906040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.906353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.906676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.914440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.915887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.929156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:07.930099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:07.930619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:07.931121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:07.931296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:07.932203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:07.933208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:07.935153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:07.935666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:07.937210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 351/695] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:07.937698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:07.938057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:07.952609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 345/696] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:07.953756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.020827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.068835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aaa0d7-be87-461b-94af-55f81a45c47e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.073326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2696969-7177-41ee-8398-b65ad7c0f0f0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.106676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.107398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.107680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.108081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.108962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:08.109553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.111599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.112513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.120435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.121855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.122341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.123721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.124597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.126188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.136622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 346/697] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:08.137528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:08.147078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:08.148068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:08.148958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:08.157159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 352/698] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 13 09:45:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:08.158702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.255675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448dd40-cf49-4843-a66f-a567f93411d8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.270468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.294044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.295058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.295661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.295777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.302161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0d1a9-9e94-4fc0-9af5-cfa0ab467168 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.303220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.304823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:08.319353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:08.320483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:08.321626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:08.326666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 347/699] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:08.327624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.346358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.347551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.347972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.348431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.428964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.433658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.436165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.459825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9540e6b2-a59e-41f0-8d65-074422b43cb4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.519468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.520983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.521421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.522117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.523020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:08.523751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.526253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.532335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 348/700] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:08.533409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.568006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 353/701] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 13 09:45:08.568006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.585849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.659028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812ef93-9189-4876-a68e-e2a7ff18906d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.683886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.691547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab650b1-22a5-4f79-acac-e60c59438a08 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.702462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.703134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.703417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.703694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.704479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:08.704788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.706226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.723677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 349/702] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:08.723677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.734501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.735169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.735447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.735719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.736421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:08.736737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.738096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eae8eb-e081-4728-9396-ca5cfb1a6553 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.754628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 354/703] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:08.756993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51df7d-91df-4d03-9c8c-c493194bf7ac None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.757278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51df7d-91df-4d03-9c8c-c493194bf7ac None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.757551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51df7d-91df-4d03-9c8c-c493194bf7ac None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.764591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 355/704] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:08.765576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51df7d-91df-4d03-9c8c-c493194bf7ac None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.852635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:08.861473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372b3e2-22c5-4bd2-9423-23ffc7988d17 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.900265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51df7d-91df-4d03-9c8c-c493194bf7ac None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:08.910883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.911696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.911978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.912252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.925497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.927269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.941590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:08.942250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.942568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.942845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.943676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ad683d737d594402850ef0af27d6e103) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:08.943993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:08.945439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4b78927f-1470-433d-b1e5-31d281080ff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:08.946645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:08.947524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:08.949407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:08.949407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:08.949407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:08.949407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:08.949407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 350/705] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:08.949407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:08.949756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:08.949756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:08.957617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 356/706] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/role_assignments?user.id=ad683d737d594402850ef0af27d6e103&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:08.962550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:08.969906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:08.971599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:09.031889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.067450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 351/707] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:09.114045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.173622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a0d73-f682-4aaf-a6e0-8b52719376df None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.217230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.217789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.218072 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.218345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.219125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:09.219439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.220200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.223140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.237644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 357/708] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:09.243146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.245837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3dffa2-f729-42fe-8f1d-32cc0d9f1ed5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.286971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.288106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.288565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.289037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.303636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.305439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:09.326706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:09.327689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:09.328592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:09.328592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:09.328592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:09.328592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:09.328592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 352/709] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:09.333916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.351725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.374722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a966d2-1bdf-4cd7-8f0b-6cb32feab9ab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.414222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.415095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.415095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.415297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.424512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.425967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-12a4f3d0-4b68-4717-add8-eaabdcd38005 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:09.447243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:09.448339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:09.449534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 358/710] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:09.450056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4c2d-bc4f-455d-821b-bdac2167007e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.450056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4c2d-bc4f-455d-821b-bdac2167007e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.451068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4c2d-bc4f-455d-821b-bdac2167007e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.451730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 359/711] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:09.455294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c4c2d-bc4f-455d-821b-bdac2167007e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.470249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8fdbd-f9e4-49bc-b5a1-95a3d4d62658 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.506620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.515998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.517079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.517460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.517839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.518865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:09.519557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.521040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c59b923-73c5-4bec-8778-6335b82228ee None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.537311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 353/712] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:09.541814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.541814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.541814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.563582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:09.565775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:09.588507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c4c2d-bc4f-455d-821b-bdac2167007e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.634206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.635446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.635982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.636859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.638432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:09.639170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.641504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.648361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 354/713] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:09.649280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.671040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 360/714] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:09.677013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.686902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.768616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65daeca0-8590-4e28-8272-c552c29b3354 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.782378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a345011-1d8b-48b1-8700-566ad71fd905 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.797562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.813521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.814543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.815062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.815497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.816343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.818190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.822299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.823221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.823501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.823776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] PATH_INFO: `/v3/services/network` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:09.824419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:09.825774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:09.839190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:09.840499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:09.841474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 361/715] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:09.842323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.850817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 355/716] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:45:09 2022] POST /identity/v3/users => generated 254 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:09.852203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:09.914378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:09.960667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a54016-0172-4c8b-a131-db8b34c4d43e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.996153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc9ddf-25be-4a26-9a03-eb4d117bc02c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:09.997586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:09.998267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:09.998580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:09.998879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:10.000046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=339f9bc083674bf897023509101fc7dc) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:10.001278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:10.001917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:10.008867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 362/717] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/role_assignments?user.id=339f9bc083674bf897023509101fc7dc&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:10.039558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:10.040686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:10.041186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:10.041681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:10.042734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] RBAC: Adding query filter params (name=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:10.043290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:10.044950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0723c675-2b69-472f-bd18-612ab2adfb8b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:10.051017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 356/718] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:10.058514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:10.192365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7520ff-a2ab-450b-93ab-96ab52bd8bd8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:10.225264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:10.237795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:10.238496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:10.238781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:10.239053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:10.239767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:10.240077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:10.241454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f5a32-6a58-4123-b333-05ed18ee7948 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:10.249417 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 363/719] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:11.176302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d008e-638c-487e-95cf-a620588506c0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:11.176840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d008e-638c-487e-95cf-a620588506c0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:11.176840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d008e-638c-487e-95cf-a620588506c0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:11.178534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 357/720] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:11.183787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1dbff-20e0-45e3-bbeb-ce83eb06122f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:11.184198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1dbff-20e0-45e3-bbeb-ce83eb06122f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:11.184337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1dbff-20e0-45e3-bbeb-ce83eb06122f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:11.207416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d2c1dbff-20e0-45e3-bbeb-ce83eb06122f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:11.208616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d2c1dbff-20e0-45e3-bbeb-ce83eb06122f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:11.287300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 364/721] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:11.317679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d008e-638c-487e-95cf-a620588506c0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:11.377538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:11.460354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d008e-638c-487e-95cf-a620588506c0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:11.508087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65d0cf-593c-4ad4-9e7d-e6ef0d32628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:11.508766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d0cf-593c-4ad4-9e7d-e6ef0d32628a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:11.509052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d0cf-593c-4ad4-9e7d-e6ef0d32628a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:11.509332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65d0cf-593c-4ad4-9e7d-e6ef0d32628a None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:11.510067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65d0cf-593c-4ad4-9e7d-e6ef0d32628a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:11.511503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65d0cf-593c-4ad4-9e7d-e6ef0d32628a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:11.538707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 358/722] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:11 2022] POST /identity/v3/services => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:11.580013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f776c70-78db-4c1c-b2e1-0796242f62b1 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:11.580725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f776c70-78db-4c1c-b2e1-0796242f62b1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:11.581244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f776c70-78db-4c1c-b2e1-0796242f62b1 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:11.583366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 365/723] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:11.589875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb2441-f637-466e-a87a-20b830912289 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:11.590601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb2441-f637-466e-a87a-20b830912289 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:11.591112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb2441-f637-466e-a87a-20b830912289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:11.616182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-43bb2441-f637-466e-a87a-20b830912289 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:11.617777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-43bb2441-f637-466e-a87a-20b830912289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:11.745366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 359/724] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:11 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:11.770145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f776c70-78db-4c1c-b2e1-0796242f62b1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:11.896554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f776c70-78db-4c1c-b2e1-0796242f62b1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:11.929458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:11.943886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:11.944691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:11.944968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:11.945238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:11.964425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:11.974854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:11.975809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:11.976664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:11.977341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 366/725] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:11.986148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb2441-f637-466e-a87a-20b830912289 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:12.033140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:12.136312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb2441-f637-466e-a87a-20b830912289 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:12.182041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:12.182978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.183271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.183589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.184360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:12.184675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:12.186081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:12.197181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 360/726] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:12.203105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:12.390599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b843286-2f4d-4f46-ab2f-99133dcc339a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:12.439586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:12.440390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.440672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.440944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.454250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:12.456833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-725a2586-ddc8-4d4a-8cfb-f328f0fe4be6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:12.483129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:12.484151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:12.485089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:12.485089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:12.485089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:12.485089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:12.485323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 367/727] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:12.492186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:12.636216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:12.660738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5542f4-8ace-4cc5-b61d-902d20eb4fda None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:12.709083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:12.710158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.710678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.711170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.712100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:12.712623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:12.714481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:12.727951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 361/728] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:12.728169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7258-e3d0-4a05-8c59-b9a5f46caec6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.728322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7258-e3d0-4a05-8c59-b9a5f46caec6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.728780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7258-e3d0-4a05-8c59-b9a5f46caec6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.730399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 368/729] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:12.733815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:12.737707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5167f-b9d4-4c16-9c05-3d90011d7f94 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.738230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5167f-b9d4-4c16-9c05-3d90011d7f94 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.738725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5167f-b9d4-4c16-9c05-3d90011d7f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.770478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0df5167f-b9d4-4c16-9c05-3d90011d7f94 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:12.771652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0df5167f-b9d4-4c16-9c05-3d90011d7f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:12.842838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:12.874914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9645c-a4b5-48a3-9efb-e33bf85f6701 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:12.880382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 369/730] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 13 09:45:12.881804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04027d-c2c1-4ef9-ba98-129741be4931 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.882184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04027d-c2c1-4ef9-ba98-129741be4931 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.882559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04027d-c2c1-4ef9-ba98-129741be4931 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 370/731] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c30bf-c27c-4640-963c-872e85ff4a65 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c30bf-c27c-4640-963c-872e85ff4a65 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c30bf-c27c-4640-963c-872e85ff4a65 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 371/732] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.892445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.892983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.908457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:12.909904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:12.923925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:12.924730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.925012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.925289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.933043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:12.934605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8a5d0468-4010-4734-8afd-52221106fd8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:12.948782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:12.949783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:12.950805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 362/733] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:12.951407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:12.951824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:12.951916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:12.968511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:12.969726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:12.971838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.002465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 372/734] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:13.002465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.054897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 363/735] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:12 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 13 09:45:13.058437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.098464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.101895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42534828-2c3e-4baa-bacf-09d7401a9429 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.137191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.138300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.138614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.138892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.149549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:13.157250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:13.158441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:13.159332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 373/736] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:13.160040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.172987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d870e99-a8be-4d1e-a26a-c6afdfa80ccf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.211059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.211913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.212202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.212481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.213354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:13.213698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:13.215166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:13.224220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.235227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 364/737] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:13.240142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.269915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f6639-2729-4f32-9f5c-58900019c3e2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.304950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.305754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.306037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.306312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.317180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:13.324801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:13.325762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 374/738] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:13.327569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.348080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.357443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d13aa-b8ff-412a-9e0c-9d6d69f01380 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.395791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.396464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.396745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.397020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.397739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:13.399147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:13.413495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 365/739] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:13 2022] POST /identity/v3/services => generated 240 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:13.414228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.440920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb24860-8d70-41cb-bb72-3fdc92cc4014 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.487171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.488175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.488667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.489121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.490170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:13.490684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:13.492377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:13.503145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 375/740] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:13.504302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.507397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.573328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674061c-21c5-40af-a849-7cb7574914a5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.606601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.618975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.619698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.620138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.620483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.635024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2387e7b-b230-430f-a4d4-55d2eea86af9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.680583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.681404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.681761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.682107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.686729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:13.686729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:13.686729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:13.694634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 376/741] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:13.695592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.712572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:13.714792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:13.783161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.798714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20cda5-d6fe-4119-b456-4b5f57d51197 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.834738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.835648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.836123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.836587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:13.845229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:13.847304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 366/742] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:13.848431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.849472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:13.851194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:13.870644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:13.871761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:13.872853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:13.872853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:13.872853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:13.872853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:13.874809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 377/743] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:13.875441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:13.958790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83becd9-be60-4b66-b027-3f5d50722ade None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.985129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babb0bf-10eb-4071-84f2-6afcfd72a85d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:13.994265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:13.995442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:13.995898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:13.996310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.007242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.008871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.022750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.023678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.024063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.024455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:14.028917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:14.029973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:14.031096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:14.031096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:14.031096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:14.031096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:14.037291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 367/744] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:14.038500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.038723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.040306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.051056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:14.060974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:14.061903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:14.062842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:14.062842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:14.062842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:14.062842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:14.065262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 378/745] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:14.066560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.125529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.150723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c5448-73ba-493a-a7f1-6e6f8c2b758f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.187584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.188296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.188526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.188789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.189644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:14.189820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.191183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.196266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc559a9f-6ac0-47c7-aee0-4409f71fac70 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.207623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 368/746] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:14.207623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.236583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.237256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.237535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.237807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.238576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:14.238880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.240238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154249c-8bba-4948-adb6-52e9b6af6c98 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.253152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 379/747] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:14.256576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adceb-d5de-4987-97e8-e8977e9fb013 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.257041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adceb-d5de-4987-97e8-e8977e9fb013 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.257854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009adceb-d5de-4987-97e8-e8977e9fb013 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.260439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 380/748] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:14.260439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adceb-d5de-4987-97e8-e8977e9fb013 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.284841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.321670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b55143-ad17-46f0-a206-eeb5dfb23b29 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.359786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.360447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.360723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.360994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.361777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:14.362079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.363496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.376823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 369/749] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:14.377638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.381945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009adceb-d5de-4987-97e8-e8977e9fb013 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.383908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.423211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.424019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.424303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.424581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.432668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.434239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e1ae69a8-6b1f-44f8-b112-3456bc296631 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:14.450307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:14.451289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:14.452249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 381/750] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:14.452849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.453426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.453426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.469938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:14.471147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:14.495036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a97a31-0d93-4eff-ab71-247d2342aba3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.524277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.536475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.537348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.537572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.537847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.554441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 382/751] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:14.554441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.556247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.559148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:14.576169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:14.577150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:14.578127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 370/752] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:14.578754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.655282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.665211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a131db-0c4f-4b6d-ae90-33997264d618 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.688509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8067b-391f-4016-becc-e80d4c3f8da3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.709928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.711237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.711681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.712300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.720092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.721550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.723718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.724396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.724680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.724954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.725787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:14.726097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.727605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:14.735411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:14.736321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:14.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 383/753] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:14.737710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.752209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 371/754] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:14.753049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.800650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:14.852392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7dfb3-78e1-4d06-9984-e4ee8d49af78 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.856661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d2e16-c65e-43f6-8ec9-60a10ceec47f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:14.889915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.890760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.891042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.891313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.891962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.892230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:14.892909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:14.893193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:14.893353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.893497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:14.894515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:14.894830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:14.896300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:14.906107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:14.907222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:14.908064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 384/755] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:14.908981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.922437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 372/756] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:14.922437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:14.933870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.023780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bf62a-27f7-4c28-a97e-3b3211b58f68 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.027966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8abff-2226-40e6-a4bd-5114aeffd305 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.031122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.061941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.062963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.063141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.063564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.064548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.064868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.066303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.071243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.072073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.072518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.072974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.079488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 385/757] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.080320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.152017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.153629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.165545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.191396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79eb970-e46e-4f2c-a603-876ec8f04c4f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.234431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.235556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.235840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.236118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.237366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.237790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.239477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.250333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 386/758] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.250333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.259780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 373/759] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:15.264645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.267500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.361323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c91f9-a8f3-4275-94a2-30984d92adf0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.374766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774417c1-96dc-4519-ad58-9eef6903688b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.400518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.401341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.401623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.401898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.410348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.413458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.415498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.416549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.417298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.417571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.417850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.418714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ad683d737d594402850ef0af27d6e103) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.419035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.420466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.426530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 374/760] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/role_assignments?user.id=ad683d737d594402850ef0af27d6e103&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.427327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:15.445477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:15.446489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:15.447867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:15.447867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:15.447867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:15.447867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:15.447867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 387/761] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:15.448423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.519096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.571626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca2189-3d4c-49da-9967-1c37f9d8c37f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.586225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df2e8-9a58-4458-b5c2-909be60300e6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.611096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.611848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.612070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.612344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.613066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.613373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.614814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.626767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 375/762] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.626767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.738486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35b5f8-3c88-4f49-9e21-7fff20a9754e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.740706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.741693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.741877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.742214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.753195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.754656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.770885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-17b6d056-76ae-4994-a28d-55cb674a1fc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:15.773050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:15.774001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:15.775656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:15.775656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:15.775656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:15.775656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:15.777940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.778649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.779000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 388/763] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:15.779184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.779468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.780197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.780290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224302-463e-4864-b473-086b720bf5e7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.780508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.780602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224302-463e-4864-b473-086b720bf5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.780781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0224302-463e-4864-b473-086b720bf5e7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.781878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.786153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 389/764] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:15.786942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224302-463e-4864-b473-086b720bf5e7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.801195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 376/765] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.801195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.836647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:15.900019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0224302-463e-4864-b473-086b720bf5e7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.907085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06392bf5-bc87-4226-821b-711da83105ec None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:15.936685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.937451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.937737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.938015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.938945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] RBAC: Adding query filter params (interface=public, service_id=85e9d837061f4a1faaf28fae3b8bca46, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.939384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.941144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508c4f52-f68a-4a90-a4e2-e39df341a556 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.942085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:15.942944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.943198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.943475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.944198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:15.944509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:15.945880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:15.950378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 390/766] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/endpoints?service_id=85e9d837061f4a1faaf28fae3b8bca46&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.951760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:15.952045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:15.952319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:15.961302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 377/767] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:15.962353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:15.971291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:15.972946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:16.023865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.044678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 391/768] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:16.045922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.084116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815364e-54a9-4939-92b2-2c6b44babc63 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.096689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.120886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.121698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.121983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.122256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.130150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.131629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:16.147408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:16.148413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 378/769] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:16.149294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.164824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0955bf5-2f0c-40b0-b954-16dfdcf64658 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.199568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.200232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.200514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.200892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.201466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.202862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.208040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 392/770] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:16.208720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.286923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d363c4c-ed39-41d9-a842-ba3c448f5100 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.307029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.326177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472dcb-3f04-4ab7-911f-6897d90720d5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.328729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.335408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.336386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.336774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.337118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.345421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.347164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:16.362576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:16.363528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:16.364418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:16.369430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 379/771] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:16.370542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.379711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.381143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.381586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.381994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] PATH_INFO: `/v3/services/network` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.383176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.384824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:16.397728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:16.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:16.400075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 393/772] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:16.401703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.500965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873aef-73bb-4c64-badd-74e7007be1c7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.526295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b5e26-7aed-4e27-9e96-5ff825dcfbcd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.549157 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.549827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.550101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.550372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.551206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:16.551513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.552939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.568162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 380/773] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:16.569014 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.576283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.577313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.577783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.578289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.579282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:16.579834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.581509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.595443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 394/774] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:16.596650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.606658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.625966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.679946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf789c8-d840-4572-809f-056ea83f5fb7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.702580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288c6fa-9339-42c0-a552-363ba1f96e1a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.715136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.715847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.716072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.716349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.717045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] RBAC: Adding query filter params (name=network) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:16.717346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.718725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.727968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 381/775] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:16.728892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.740916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.742094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.742599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.743108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/339f9bc083674bf897023509101fc7dc/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.746031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=339f9bc083674bf897023509101fc7dc, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.747928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.766490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 395/776] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:16 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/339f9bc083674bf897023509101fc7dc/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:45:16.768813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:16.834854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.843460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fb8ea-fc1a-4813-9a41-85090ef0c19b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.882282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.882557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.882787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.883060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.883897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ed4faddf2f4d4b6fa1d61c8a276724e2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:16.884208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.885898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.893289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 382/777] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/role_assignments?user.id=ed4faddf2f4d4b6fa1d61c8a276724e2&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:16.903577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:16.926391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97aca9e-a842-42f4-8744-d9f0df469c93 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:16.970304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:16.971422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:16.971902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:16.972366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:16.973309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:16.973812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:16.975437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:16.982121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 396/778] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:16.989514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:17.104099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97b481-05b4-41d5-a967-a59595c42b82 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:17.144508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:17.145174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:17.145455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:17.145734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:17.146561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] RBAC: Adding query filter params (interface=public, service_id=de5ecbdc0ed7451782af6c41ea8ae982, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:17.147159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:17.148570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd813f41-58d8-42be-8ea7-491511d1127f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:17.157996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 383/779] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:16 2022] GET /identity/v3/endpoints?service_id=de5ecbdc0ed7451782af6c41ea8ae982&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:17.163160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:17.278800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edfbd97-9807-4a8d-96c6-07e3995951a1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:17.327907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffad6b8b-25d8-45bf-b4fe-fcfd6d30af6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:17.328629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6b8b-25d8-45bf-b4fe-fcfd6d30af6b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:17.328916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6b8b-25d8-45bf-b4fe-fcfd6d30af6b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:17.329192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffad6b8b-25d8-45bf-b4fe-fcfd6d30af6b None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:17.329878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6b8b-25d8-45bf-b4fe-fcfd6d30af6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:17.331284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffad6b8b-25d8-45bf-b4fe-fcfd6d30af6b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:17.337546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 397/780] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:17 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:17.546198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fb373-29f7-41e4-b932-b8e9ef4b3300 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:17.547322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fb373-29f7-41e4-b932-b8e9ef4b3300 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:17.547801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fb373-29f7-41e4-b932-b8e9ef4b3300 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:17.549377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 384/781] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:17.555268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:17.555724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:17.555824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:17.587606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:17.588880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:17.601222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:17.679377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 398/782] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:17.703688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fb373-29f7-41e4-b932-b8e9ef4b3300 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:17.733430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:17.839635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fb373-29f7-41e4-b932-b8e9ef4b3300 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:17.886376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:17.887246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:17.887521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:17.887792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:17.905752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:17.913333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:17.914271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:17.915162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 385/783] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:17.920934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:18.061198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026ac51-d45a-4493-80fa-c975416d9a5b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:18.108487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:18.109175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:18.109459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:18.109738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:18.110608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:18.110918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:18.112288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:18.126512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 399/784] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:18.132046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:18.254018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:18.275869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d50af3-befd-486e-91b0-b367250b02a7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:18.325025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:18.325741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:18.326020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:18.326291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:18.341217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:18.342709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:18.360948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:18.361917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:18.362871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:18.362871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:18.362871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:18.362871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:18.362871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 386/785] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:18.369805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:18.388442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:18.514859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc7a241-8a16-4edd-8607-9eeca13cde54 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:18.565926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:18.566717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:18.566919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:18.567192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:18.567920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:18.568227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:18.569595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:18.587788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 400/786] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:18.593287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:18.735648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30558c-b4b5-470f-9500-706c040fff6d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:18.781172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:18.782330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:18.782843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:18.783305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:18.791463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:18.799650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:18.801451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-61755a7b-a108-4223-8690-5ae9dd6d8136 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:18.822060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:18.823153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:18.824727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 387/787] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:18.831521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:18.869495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2cb4-d502-4f88-84f1-0b3e6b243caa None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:18.869686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2cb4-d502-4f88-84f1-0b3e6b243caa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:18.870701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf2cb4-d502-4f88-84f1-0b3e6b243caa None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:18.872308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 388/788] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:18.878438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:18.878719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:18.879130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:18.910445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:18.911668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:18.932909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:18.969579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f3924-a8db-4d2d-a307-fdf4d4f37d74 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.016774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 389/789] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:19.017246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.018006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.018289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.018590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.019447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:19.019758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.021267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.041836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.059763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 401/790] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 09:45:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:19.065476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.172242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7cd57-6419-4a46-b1d6-a53cd705cbb2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.200029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.210879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.212009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.212496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.212971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.213854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.215496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:19.230214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:19.231245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 13 09:45:19.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:19.235106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 390/791] 10.222.0.17 () {56 vars in 1129 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:19.240426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.290257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664addf-1b64-445d-bcd1-73c0bf72e990 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.314863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.326843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.327703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.327913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.328187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.338807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.340377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.351480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b880d0c-b5dd-4355-b73c-e7b2909bf645 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6e8df07b-ed08-4769-abc2-5b5d2ce47c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:19.358743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:19.359637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:19.361180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:19.361180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:19.361180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:19.361180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:19.361180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 402/792] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:19.361587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2734-1cba-4bd6-872f-035fe2d34cab None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.361867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2734-1cba-4bd6-872f-035fe2d34cab None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.362139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f2734-1cba-4bd6-872f-035fe2d34cab None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.373744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 403/793] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:19 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:19.374927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2734-1cba-4bd6-872f-035fe2d34cab None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.396935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.397962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.398529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.399008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.399964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:19.400494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.402206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1809f1d-7d5c-452c-b65d-d4a02e93a916 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.407959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 391/794] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:19.409487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.409995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.410538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.428546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:19.430102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:19.484032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.489733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f2734-1cba-4bd6-872f-035fe2d34cab None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.505480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 392/795] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:19.506999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.540083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.540747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.541041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.541298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.542103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:19.542536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.543940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbb89ea-7544-40be-a998-94b1dd0818b4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.555892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 404/796] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:19.557164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20952676-3c40-4969-b758-ec3c36fc2867 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.557654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20952676-3c40-4969-b758-ec3c36fc2867 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.558063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20952676-3c40-4969-b758-ec3c36fc2867 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.559750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 405/797] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:19.560459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20952676-3c40-4969-b758-ec3c36fc2867 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.599796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.619443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324d994-aa1d-451b-ae09-755625b198ec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.655786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.656549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.656891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.657169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.657886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:19.658193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.659593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.665055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 393/798] 10.222.0.17 () {56 vars in 1124 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:19.665875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.673206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20952676-3c40-4969-b758-ec3c36fc2867 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.709058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83f9ff-24f9-4cdb-a6a3-1b5ca358c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.709857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83f9ff-24f9-4cdb-a6a3-1b5ca358c3ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.710142 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83f9ff-24f9-4cdb-a6a3-1b5ca358c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.710443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83f9ff-24f9-4cdb-a6a3-1b5ca358c3ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.716256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.722693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83f9ff-24f9-4cdb-a6a3-1b5ca358c3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9b83f9ff-24f9-4cdb-a6a3-1b5ca358c3ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:19.730438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:19.731387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:19.732261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 406/799] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:19.733717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.733717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.733892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.750310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:19.751533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:19.780809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c842a-a404-4248-930e-4db0fa6eeae5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.816290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.817094 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.817376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.817651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.822275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 407/800] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:19.823361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.824890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.826352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:19.840805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:19.841785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:19.843116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 394/801] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:19.843700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.862187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.939728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cc396-8b56-4ea6-a8c9-31c44f8e64f1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.951015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5227d-1a07-4eaf-b3f9-d4dc97d2dabe None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:19.960045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:19.973942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.974650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.974930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.975199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.975933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.977306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.985042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:19.985773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:19.986054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:19.986328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:19.987130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:19.987454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:19.988764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:19.997285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 395/802] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:19.998076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:19.998643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 408/803] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:19.999302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.098410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.125215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d570f586-e29e-4278-aefc-806e710def9b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.125577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf6ab-41cf-44cc-a8fa-eec4b3a87a12 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.167398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.168334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.168488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.168618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.168894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.169183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.169460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.169694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:20.169791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.170992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.171482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1cd5d-1f9b-44f0-b9f6-a5a084eb63b0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.181511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:20.186500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 396/804] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:20.187904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708e34-b848-4688-90cb-3cd1eb9dbb7d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.188196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708e34-b848-4688-90cb-3cd1eb9dbb7d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.188476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1708e34-b848-4688-90cb-3cd1eb9dbb7d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:20.189817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:20.190937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:20.191931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:20.192738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 397/805] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:20.192738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708e34-b848-4688-90cb-3cd1eb9dbb7d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.192887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 409/806] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:20.196514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.224220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.303167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afdce01-5277-48fb-aabe-a2af3228094a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.307695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1708e34-b848-4688-90cb-3cd1eb9dbb7d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.340963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.341627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.341903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.342176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.342946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:20.343246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.344618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.350511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.351360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.352154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.352576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.352870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.361539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 410/807] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:20.362446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.365818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.366896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8583dfea-1676-40bc-8155-d0394cfd02c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:20.384828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:20.385953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 398/808] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.392160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.408018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:20.409268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:20.480608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 399/809] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:20.482672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fd4881-ff7a-4f0d-bcd5-9fab8c9e4901 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.488002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.507632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.526770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.527826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.528198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.528474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ad683d737d594402850ef0af27d6e103/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.530462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=ad683d737d594402850ef0af27d6e103, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.531890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.548119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 411/810] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:20 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ad683d737d594402850ef0af27d6e103/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:45:20.549269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.625245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6348c2-91bd-4847-8a70-0bb81f4fdd21 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.646686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.670046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.671261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.671678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.672087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.688172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.689682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.709796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65273852-afc5-417f-887e-d0ab9e3a9a07 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:20.711794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:20.712718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:20.714820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:20.714820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:20.714820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:20.714820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:20.717873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 400/811] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:20.718872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.755493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.756174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.756534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.756879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.757675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:20.757989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.759389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.773747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 412/812] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:20.775484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.801816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.846011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e66f3d-26c0-4c23-a348-0a2fb4d24509 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.892279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.893198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.893540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.893880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.894619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.896059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.907448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44aa21e-e313-4ea0-86c5-0d1f4ab492a0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:20.908359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:20.909361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:20.910333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 401/813] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:20.911164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:20.938547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:20.955296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:20.955962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:20.956297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:20.956571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:20.957338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:20.957643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:20.959061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:20.976374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 413/814] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:20.977301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.039735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef8994-cde7-444b-8f7c-5cb0ddb567e7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.069504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.080175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.081347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.081828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.082300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.085585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b912260a-a6e2-4fa2-ac31-4fa6ccd0582b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.091568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.093032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:21.108687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:21.109679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 402/815] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:21.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.126883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.127635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.127976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.128310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.129074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] RBAC: Adding query filter params (name=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:21.129452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.130900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.136139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 414/816] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:21.137094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.187836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.232487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517f27c-cacd-4954-8960-b078b9f8cf95 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.257310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ae72b-e23f-44c4-84df-81bc12ad7733 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.285682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.287073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.287699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.288452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.294595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.295397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.295746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.296123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.297072 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:21.297442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.299035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.299876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.301643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.317888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 415/817] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:21.318909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:21.325475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:21.326469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:21.327407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:21.330575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 403/818] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:21.331943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.398714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.437662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237359ac-c4d1-4065-8236-c19e8e62300f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.439443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.454543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd2cb5-00e1-48ad-82c5-18d0baad0bdf None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.475723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.476659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.477135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.477561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.478527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] RBAC: Adding query filter params (type=network) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:21.478985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.480614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.486485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 416/819] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:21.487591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.490294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.491982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.491982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.491982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.503690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.505244 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:21.523998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:21.525033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:21.525979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:21.525979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:21.525979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:21.525979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:21.525979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 404/820] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:21.526698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.599434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500d0d1-341e-4e76-83af-869d2cec90ae None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.631056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.634191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefab6d-7c12-4da7-bdf8-af181e6f4040 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.640791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.641760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.642344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.642856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.643884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:21.644491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.646214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.665952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 417/821] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:21.667827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.671134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.672465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.672465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.672465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.673166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.674592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.696885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.703812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 405/822] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:21.705361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.782878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb3f83-a7ef-4d01-a737-81e0d50baf02 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.841179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00798e1b-5c51-4d0c-a7ba-998ceb0661d2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:21.851560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.852512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.852936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.853366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.854302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:21.854931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.856512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.886458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 418/823] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:21.887776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:21.892917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:21.892917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:21.893344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:21.893768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:21.920599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:21.973710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:21.975745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:21.996815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.019137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbd2175-4d89-4e23-883f-9f5f4cae5f31 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.054361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.055188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.055465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.055739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.063384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.065050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:22.080883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:22.081841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:22.082790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 419/824] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:22.087902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.089731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 406/825] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:22.107785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.171388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.218490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f052c397-7fd2-4928-a86c-ce86e92fe052 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.233565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef7673-4471-490c-85c7-5441af7ad571 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.259390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.261003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.261486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.262186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.263699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:22.264500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.266384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeef250-177b-43a8-8ef6-f1cbfd899257 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.268654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.269455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.269759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.270002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.278448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.280951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.282569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.283414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 420/826] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:22.284750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cc1f7-43b0-4429-9223-2d776fea6fce None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.285450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cc1f7-43b0-4429-9223-2d776fea6fce None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.285729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cc1f7-43b0-4429-9223-2d776fea6fce None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.287150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 421/827] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:22.291317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cc1f7-43b0-4429-9223-2d776fea6fce None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e27c84c1-be8c-49d4-a3cc-a16efaf9f5cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:22.309745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:22.310736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:22.311651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:22.311651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:22.311651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:22.311651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:22.311651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 407/828] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:22.312618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.312618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.312788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.332568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:22.333767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:22.409507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 408/829] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:22.410509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.419820 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cc1f7-43b0-4429-9223-2d776fea6fce None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.451503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.457618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.458613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.458954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.459290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ed4faddf2f4d4b6fa1d61c8a276724e2/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.474546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=ed4faddf2f4d4b6fa1d61c8a276724e2, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.476038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.489548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 422/830] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:22 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ed4faddf2f4d4b6fa1d61c8a276724e2/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:45:22.490672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.538520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50720ee1-12f8-418c-af66-18388ac14837 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.562574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.583554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.584588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.585147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.585567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.586681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:22.587141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.588822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.608144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 409/831] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:22.615997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.638626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7ef386-5a2a-4b02-a696-4e38670694f8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.676391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.678047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.678317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.678664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.679324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.680690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:22.699212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:22.700792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:22.701980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:22.704007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 423/832] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:22.710341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.734722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.744728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6f8de-c427-40a3-88b7-40968b4fe7ca None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.789817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.790650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.790934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.791736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.801132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.802923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.816416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bb7c5-aade-4e53-a07c-d23f911e6663 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:22.823013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:22.823891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:22.824769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:22.829817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 410/833] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:22.831160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.831688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:22.856178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.857282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.857567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.858156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.858998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:22.859442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.861519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71893f34-b9db-462e-b899-2f2537ce08b0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:22.868178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 424/834] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:22.875433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72533-8780-4861-b187-2743839f74fe None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.875719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72533-8780-4861-b187-2743839f74fe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.875995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab72533-8780-4861-b187-2743839f74fe None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 425/835] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:22.878167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab72533-8780-4861-b187-2743839f74fe None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:22.946363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627de10-40c7-4f08-8915-d342e49885b6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.984483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:22.985511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:22.985860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:22.986135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:22.986980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:22.987278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:22.988408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab72533-8780-4861-b187-2743839f74fe None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:22.988709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d30ef-a5d8-4cc2-87fb-7e057306fcdd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:23.002046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 411/836] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:23.003174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.003532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.003723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.021165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:23.022344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:23.028639 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.029556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.030455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.030909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.032117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:23.032452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:23.033178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:23.033851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:23.050447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 426/837] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:22 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:23.050447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:23.102290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 412/838] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:23.106607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:23.128805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:23.172138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c0b35-a68f-43ea-b7db-c64d16b5d1af None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:23.210095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.210990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.211368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.211740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.212703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=339f9bc083674bf897023509101fc7dc) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:23.213115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:23.214779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:23.222269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 427/839] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:23 2022] GET /identity/v3/role_assignments?user.id=339f9bc083674bf897023509101fc7dc&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:23.250137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009961c-7074-4960-a051-0d29cfb1fb7d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:23.290856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.291928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.292302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.292687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.305497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:23.313662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:23.314884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:23.315918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:23.317892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 413/840] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:23.324283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:23.438126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958e8a6-8000-4f39-bd7e-fc0ceb029647 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:23.445780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:23.474771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.475522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.475894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.476317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.477127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:23.477525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:23.479034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:23.488407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 428/841] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:23.494006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:23.498721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:23.598265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed5b7-af30-4ecc-93c6-7a68a97c46c0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:23.633102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.633904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.634183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.634583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.648876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:23.650391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:23.668561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:23.669584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:23.670683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:23.670683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:23.670683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:23.670683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:23.670683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 414/842] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:23.675467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:23.784010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed66f09c-ccd7-4165-a263-cdfbfaa4751d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:23.824346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.825017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.825296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.825570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.826298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:23.826637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:23.828001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:23.840953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 429/843] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:23.847544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:23.906801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:23.950746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75db241-78de-4b68-b031-2e9f6aa6657e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:23.983424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:23.984219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:23.984550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:23.984819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:23.993351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:23.994924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:24.009047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:24.010013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:24.012132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 415/844] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:24.016641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:24.045351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:24.120816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109829-5a89-4bdb-852f-6d839f187a5b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:24.159221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:24.159964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.160241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.160510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.161341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:24.161644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:24.163098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:24.185972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 430/845] 10.222.0.17 () {56 vars in 1135 bytes} [Wed Jul 13 09:45:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:24.191356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:24.415059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efd81b5-5ca5-480c-8228-f7c7b2bd1797 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:24.431621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:24.449336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192bde9-b84c-40f1-bca4-e4309aa59b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:24.450039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192bde9-b84c-40f1-bca4-e4309aa59b15 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.450320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192bde9-b84c-40f1-bca4-e4309aa59b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.450658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192bde9-b84c-40f1-bca4-e4309aa59b15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.518032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192bde9-b84c-40f1-bca4-e4309aa59b15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:24.519510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192bde9-b84c-40f1-bca4-e4309aa59b15 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:24.622737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 416/846] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:24 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:24.631569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:24.664842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e40fa-5a77-40dd-8023-fe340e9e7f44 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.665125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e40fa-5a77-40dd-8023-fe340e9e7f44 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.665407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e40fa-5a77-40dd-8023-fe340e9e7f44 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.667356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 417/847] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:24.672089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.672372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.672642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.689761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:24.691043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:24.702174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:24.729058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:24.745499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de016274-6296-4a15-afc6-59e34edf8a70 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:24.777917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 418/848] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:24.785106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:24.786552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.787044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.787504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.800411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:24.803082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:24.808037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:24.832395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:24.833368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:24.834265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:24.834265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:24.834265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:24.834265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:24.838291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 431/849] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:24.839464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:24.936954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa30f110-d73b-4424-96b8-14988d912e0d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:24.942406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e30882-bbc3-41b5-966f-7fb34a9144a8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:24.976935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:24.977649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.977917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.978188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.979058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:24.979362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:24.980792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:24.982191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:24.983312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:24.983589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:24.983856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:24.992610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:24.997292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:25.000559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 432/850] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:25.007721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:25.009664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:25.010690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:45:25.011740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:25.018612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 419/851] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:45:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:25.018612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.034295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.130517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f172d79-1400-4ac6-8ea3-8d2697a62670 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.161635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eeca2d-de7a-448c-abc9-015aaef6957c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.166566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.167388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.167672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.167948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.175740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.177352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:25.192830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:25.193877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:25.194827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 433/852] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:25.201535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.202585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.203325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.203615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.203888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.204693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:25.205003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.206778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f738f-090a-4cc7-bbfe-2bd6d3642443 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.218680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 420/853] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:25.220309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5cc8a-1d0d-4b75-8636-dd5823a58c43 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.220598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5cc8a-1d0d-4b75-8636-dd5823a58c43 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.220871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c5cc8a-1d0d-4b75-8636-dd5823a58c43 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.222967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 421/854] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:25.224183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5cc8a-1d0d-4b75-8636-dd5823a58c43 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.270713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.299133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.313764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f3c6f-1677-47ae-8060-5b36d7d64ef3 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.339116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c5cc8a-1d0d-4b75-8636-dd5823a58c43 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.349587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.350256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.350861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.350861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.351599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:25.351904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.353374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d33593-7f2c-43e6-a74c-113d47fd809f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.374028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.379675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.379795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 434/855] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:25.379907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.379907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.380058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.380058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.380058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.391479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.393013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.396842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:25.398196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:25.411138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:25.412072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:25.412960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:25.412960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:25.412960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:25.412960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:25.412960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 422/856] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:25.413235 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.472286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 435/857] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:25.473238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.521060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c2b7d-89a8-49c7-8f0e-4373ebf0e395 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.531393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.540897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.554838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.555476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.555788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.556058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.556873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ad683d737d594402850ef0af27d6e103) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:25.557313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.558882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.564802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 423/858] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/role_assignments?user.id=ad683d737d594402850ef0af27d6e103&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:25.565542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.588824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8a8e-fe38-465a-aeb3-32f19e82881d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.628601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.629271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.629548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.629808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.630564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:25.630871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.632277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b61c07-810a-4c20-b89b-355f38afb737 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.645696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 436/859] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:25.647108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98080-63c1-4a48-9922-26e653364922 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.647396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98080-63c1-4a48-9922-26e653364922 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.647676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f98080-63c1-4a48-9922-26e653364922 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.649305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 437/860] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:25.651288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f98080-63c1-4a48-9922-26e653364922 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.681431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634fcd5-7351-4a5d-94ce-6870a1c84456 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.720468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5cc447-9a3b-44d5-a5b1-99b9df2da709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.721150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc447-9a3b-44d5-a5b1-99b9df2da709 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.721435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc447-9a3b-44d5-a5b1-99b9df2da709 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.721705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5cc447-9a3b-44d5-a5b1-99b9df2da709 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.722519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cc447-9a3b-44d5-a5b1-99b9df2da709 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.723818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5cc447-9a3b-44d5-a5b1-99b9df2da709 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.739644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 424/861] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:25 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:25.740747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.741096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.741376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.762096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:25.764298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:25.787158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f98080-63c1-4a48-9922-26e653364922 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:25.791961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.826722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:25.842555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:25.843884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:25.844362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:25.845404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:25.857943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:25.860054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:25.866450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 425/862] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:25.881884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:25.882968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:25.883953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 438/863] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:25.888698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:25.894202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.012300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d509244-739c-4626-b07f-cddb6f01f108 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.025886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9548f96c-52dc-48e6-a932-bc7a0cc5b6a9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.049688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.050853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.051176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.051450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.052099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.053462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.068412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.069093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:26.069203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:26.070316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:26.071313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:26.072234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.072234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.072234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:26.072424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 426/864] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:26.072495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.072495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.079420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.098466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 439/865] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 09:45:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:26.104598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.124504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:26.135285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:26.189826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10fa30c-fed6-4ed6-86ef-3173d0b7b8d4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.216420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e5d77c-2220-4483-9e02-6c094b70f58a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.225164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.225828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.226106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.226378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.227369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:26.227679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.229183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.237578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 427/866] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:26.242704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.255640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.256640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.257146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.257636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.328706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.330551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.348413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dac344-7aa9-447a-9e1c-f675400cd298 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.355559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:26.371214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:26.386145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.386962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.387159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.387410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.388422 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:26.388723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.390173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.395469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 428/867] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:26.457503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 440/868] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 09:45:26.459367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.572178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca8417-6f59-4912-a9fc-5d26eb8bdaf6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.607744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.608457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.608734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.608998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.620323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.621744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:26.640062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:26.641020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:26.642345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:26.642345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:26.642345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:26.642345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:26.642345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 429/869] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:26.648721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.752423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1e09-74d2-4bca-87a3-b104f0aee6b6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.786813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:26.793773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.795151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.795671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.796164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.797134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:26.797656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.799268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.816841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 441/870] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:26.818502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:26.839149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:26.925381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1169b10d-27f7-4b9e-9799-f5bba8a7d99d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:26.962105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:26.962935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:26.963218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:26.963566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:26.970706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:26.972142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:26.986252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:26.987190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:26.988509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 430/871] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:26.995709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:27.100531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55acf81b-8356-4580-8fe3-f64b4c9e4ba0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:27.137093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:27.138446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:27.138948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:27.139417 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:27.140406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:27.140932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:27.142580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e540f5-0704-413d-bf2b-d99d263cd58b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:27.160932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 442/872] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:27.162586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:27.244659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:27.272306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ef1a3-ffff-42f0-9bc6-7757e76df2de None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:27.307259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:27.308015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:27.308297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:27.308571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:27.309396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ed4faddf2f4d4b6fa1d61c8a276724e2) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:27.309707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:27.311142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d86776-5cc9-4ea7-b9e6-5c85b7a66850 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:27.317719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 431/873] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:27 2022] GET /identity/v3/role_assignments?user.id=ed4faddf2f4d4b6fa1d61c8a276724e2&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:27.724084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907fc92-1bfe-4f13-b148-27e473a594b8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:27.724887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907fc92-1bfe-4f13-b148-27e473a594b8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:27.725363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7907fc92-1bfe-4f13-b148-27e473a594b8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:27.727265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 443/874] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:27.732871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28027907-f072-4384-8998-61af0ef2964f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:27.733395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28027907-f072-4384-8998-61af0ef2964f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:27.733882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28027907-f072-4384-8998-61af0ef2964f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:27.751246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-28027907-f072-4384-8998-61af0ef2964f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:27.752710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-28027907-f072-4384-8998-61af0ef2964f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:27.823116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 432/875] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:27.845174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907fc92-1bfe-4f13-b148-27e473a594b8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:27.856916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf08b-c694-435f-97a9-2727d4d8e038 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:27.857202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf08b-c694-435f-97a9-2727d4d8e038 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:27.857567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cf08b-c694-435f-97a9-2727d4d8e038 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:27.859311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 433/876] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:27.864323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:27.864600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:27.864868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:27.884844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:27.886119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:27.894776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:27.969191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7907fc92-1bfe-4f13-b148-27e473a594b8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:27.978570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 434/877] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:27.996580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:27.998979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:28.018632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.019455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.019737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.020012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.020671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.022607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:28.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:28.039898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:28.040749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 444/878] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:28.048037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.123112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad42233-92b1-4406-85ff-f2e5082d6798 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.157520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390ef7e-c340-40d8-9e7c-2ed65b5d72a0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.165016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.165826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.166110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.166506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.166941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:28.168311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.169904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:28.183751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:28.185025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:28.186077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:28.188665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 435/879] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:28.197571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.202063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.202773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.203054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.203326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.204041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:28.204466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.205857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.214684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 445/880] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:28.217828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.273853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:28.323670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b46b66-946a-497b-a0c2-7fe33da14af8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.337523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce51515-4344-4dfe-9e7e-815b78254010 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.363169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.364137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.364621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.365088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.366021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:28.366614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.368181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.379146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 436/881] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:28.380972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.381522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.382248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.382576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.382854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.383568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:28.383871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.385424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ba2cf0-4889-45c5-a133-7e4025bfec30 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.394889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 446/882] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:28.494651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb23b8-faf3-4dac-a0ee-ac35bdfe3500 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.527473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107809f4-c4b5-4f16-a458-f6c558154288 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.527764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107809f4-c4b5-4f16-a458-f6c558154288 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.527905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107809f4-c4b5-4f16-a458-f6c558154288 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.529735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 447/883] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:28.535348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:28.535674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.535969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.536250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.545826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.546555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.546841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.547121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.547839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:28.548150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.549539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.555557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 437/884] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:28.557122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:28.558562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:28.561419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.596210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:28.649100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 448/885] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:28.677043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.696241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5d2e0-b3a9-4cf5-8405-cf8c04d79c55 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.734930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.735695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.736033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.736309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.737142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] RBAC: Adding query filter params (interface=public, service_id=069d2fbc8f80479f9b152b180ab8ec91, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:28.737457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.739062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.745533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 438/886] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:28 2022] GET /identity/v3/endpoints?service_id=069d2fbc8f80479f9b152b180ab8ec91&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:28.750364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:28.799463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162518df-210f-447b-acbf-6a4d1ad916c1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.821809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:28.841750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0243da-a5e9-458d-b9e7-b48062e20f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.842441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0243da-a5e9-458d-b9e7-b48062e20f6b None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.842742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0243da-a5e9-458d-b9e7-b48062e20f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.843018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0243da-a5e9-458d-b9e7-b48062e20f6b None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.843749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0243da-a5e9-458d-b9e7-b48062e20f6b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.845615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0243da-a5e9-458d-b9e7-b48062e20f6b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.870737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 449/887] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:28 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:45:28.884807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c968255-d328-4663-bcd1-ae459e1c2f12 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:28.934787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7773a0e4-b571-43ec-accc-8be7f9b4fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:28.936047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a0e4-b571-43ec-accc-8be7f9b4fd20 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:28.936586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a0e4-b571-43ec-accc-8be7f9b4fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:28.937059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7773a0e4-b571-43ec-accc-8be7f9b4fd20 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:28.937950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773a0e4-b571-43ec-accc-8be7f9b4fd20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:28.939720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7773a0e4-b571-43ec-accc-8be7f9b4fd20 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:28.947289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 439/888] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:28 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:45:29.462119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc34dc-f23c-46b1-80b2-e12c99ed6256 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:29.462472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc34dc-f23c-46b1-80b2-e12c99ed6256 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:29.462708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc34dc-f23c-46b1-80b2-e12c99ed6256 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:29.464407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 450/889] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:29.469850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:29.470688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:29.471165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:29.488513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:29.489941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:29.561836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 440/890] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:29.585264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc34dc-f23c-46b1-80b2-e12c99ed6256 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:29.613004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:29.692891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc34dc-f23c-46b1-80b2-e12c99ed6256 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:29.727261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:29.728076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:29.728359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:29.728636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:29.739481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:29.749469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:29.750433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:29.751301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:29.751942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 451/891] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 09:45:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:29.757209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:29.805605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:29.862056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01494f-974c-46ee-9b3a-2f0d3706cfa0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:29.897188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:29.897857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:29.898140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:29.898427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:29.899184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:29.899492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:29.900917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:29.909828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 441/892] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:45:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:29.915519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:30.008402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:30.025020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87619c58-7963-49c5-a8ea-1e50b622f63d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:30.060545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:30.061369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.061657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.061939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.074568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:30.076043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:30.094257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:30.095261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:30.096163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:30.096163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:30.096163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:30.096163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:30.096163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 452/893] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:30.103586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:30.214728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b8142-d5d8-4382-a02b-e2036e6cb26f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:30.225827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:30.250528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:30.251196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.251482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.251763 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.252485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:30.252796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:30.254237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:30.267292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 442/894] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:30.275520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:30.383906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f473d-23ab-4f71-b908-fe855036e864 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:30.420862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:30.421735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.422017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.422290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.425180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:30.431490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:30.433120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-dd9d9458-70af-42ac-92bd-50f750ac82d9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:30.448771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:30.449737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:30.450732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:30.454569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 453/895] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:45:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:30.459550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:30.514748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13680-8ff0-46a9-b79d-82d3713be20e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.515036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13680-8ff0-46a9-b79d-82d3713be20e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.515315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f13680-8ff0-46a9-b79d-82d3713be20e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.516877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 454/896] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:30.522031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.522256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.522631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.539670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:30.540857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:30.569063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62676c68-99d1-44ad-b327-cea55aa9421f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:30.606517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:30.607502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.607961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.608388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.609363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:30.609839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:30.611532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:30.615340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 455/897] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:30 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:30.635705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 443/898] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 09:45:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:30.637309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:30.638615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:30.675382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:30.769083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cae980-e679-4fc5-9001-14b99b68743b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:30.770506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210b1f7-e86d-48c5-81f1-4cac50cacb07 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:30.811083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:30.815341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:30.816002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.816283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.816552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.826434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a558c-cd01-4645-a627-b5db8386ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:30.827106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a558c-cd01-4645-a627-b5db8386ec72 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:30.827383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a558c-cd01-4645-a627-b5db8386ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:30.827655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a558c-cd01-4645-a627-b5db8386ec72 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:30.828376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a558c-cd01-4645-a627-b5db8386ec72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:30.830308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a558c-cd01-4645-a627-b5db8386ec72 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:30.850444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 456/899] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:30 2022] POST /identity/v3/services => generated 241 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:30.908386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:30.910249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:30.944906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.012704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744812f6-a3f2-4fa9-9b2f-464e97542918 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.013542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744812f6-a3f2-4fa9-9b2f-464e97542918 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.013664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744812f6-a3f2-4fa9-9b2f-464e97542918 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.018533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 457/900] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:31.020333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4544-c247-49d1-be92-40538e7f75e8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.020625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4544-c247-49d1-be92-40538e7f75e8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.020902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f4544-c247-49d1-be92-40538e7f75e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.031915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 444/901] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:30 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:31.037621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.041006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c29f4544-c247-49d1-be92-40538e7f75e8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:31.042267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c29f4544-c247-49d1-be92-40538e7f75e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:31.121085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 458/902] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:31.122350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81efb9d-a373-44f7-b4c0-b4887b97d1af None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.122667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81efb9d-a373-44f7-b4c0-b4887b97d1af None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.122951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81efb9d-a373-44f7-b4c0-b4887b97d1af None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.124448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 459/903] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:31.129444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.129802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.130178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.151855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:31.153042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:31.153538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4917b34-1a7d-4ecb-ad2e-de2bf8c25b5a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.183255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.191779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.192579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.192860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.193134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.205090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.206597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:31.225489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:31.226528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:31.232581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:31.232581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:31.232581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:31.232581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.232581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 445/904] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:31.232581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.232983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 460/905] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:31.236661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.285418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.343271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db7d7-fb5d-4ca8-aa13-9b26b7027b61 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.348391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edaa59c-133d-4a42-821e-d1e5d0a11292 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.386651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.387430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.387736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.388304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.388981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.390333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.393886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.394581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.394861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.395136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.395856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:31.396162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.397516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:31.402985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:31.403925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:31.404795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.409468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 446/906] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:31.410071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.415946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 461/907] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:31.415946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.461582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.519564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd86e79-06ea-43d6-a7c9-d9e16e2e334a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.520169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19b5db-4065-4afc-a0c9-bb1578d8be29 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.522628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.555172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.555969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.556251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.556524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.557329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.558332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.558824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.559028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.559312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.559589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.560288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:31.560600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.561954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.566952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 462/908] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:31.570952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:31.572276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:31.573163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 447/909] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:31.573964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.574710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.681695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61680ae3-7f9e-4550-8281-b9ad06889cbc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.682271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6188d641-f388-4d32-ba1b-ece4243b6897 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.692280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.717223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.717560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.718024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.718214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.718328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.718519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.718617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.718883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.719586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:31.719889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.721396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.725662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.726304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 448/910] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:31.726985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.731514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:31.746317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:31.747315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 463/911] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:31.753125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.782708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:31.843808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90517c0d-b5ba-44da-b7e5-d867e8eeab39 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.858906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f3032-e1c6-4a05-9008-539b028cba21 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:31.879279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.879937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.880221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.880499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.881312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:31.881621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.883125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.889136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 449/912] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:31.889996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.897194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:31.897856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:31.898134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:31.898409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:31.899218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] RBAC: Adding query filter params (interface=public, service_id=2c8015e0279e48518a646bab6696f3e8, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:31.899531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:31.900942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:31.906371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 464/913] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/endpoints?service_id=2c8015e0279e48518a646bab6696f3e8&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:31.907175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:31.932756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:32.005870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ddbef-222e-40b2-9b63-457b8090a5d0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:32.006077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:32.017488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf70855-81d2-4249-ba53-9f9ce36d0d43 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:32.041632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:32.042542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.042830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.043102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.044196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:32.044509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:32.045933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:32.055672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:32.056754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.057268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.057763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.058721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:32.058827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 450/914] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:32.059312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:32.059634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:32.061091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:32.073616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 465/915] 10.222.0.17 () {56 vars in 1114 bytes} [Wed Jul 13 09:45:31 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:32.074512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:32.161872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:32.169357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f7591c-f0c9-4953-b8ca-3caa488404fd None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:32.177362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a780fd2-50ea-487f-ace4-db00b596cfdc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:32.206105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:32.206802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.207088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.207364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.208040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:32.209402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:32.211204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:32.211842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.212120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.212390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.213307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] RBAC: Adding query filter params (role.id=e5d2b52fa7bf4237a692f4ccbef1f702, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ed4faddf2f4d4b6fa1d61c8a276724e2) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:32.213614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:32.215052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd715206-5fc5-41bb-8f36-2e8caae9423e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:32.215876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 451/916] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:32 2022] GET /identity/v3/services => generated 1497 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:45:32.216561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:32.226376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 466/917] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:32 2022] GET /identity/v3/role_assignments?user.id=ed4faddf2f4d4b6fa1d61c8a276724e2&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=e5d2b52fa7bf4237a692f4ccbef1f702 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:32.345514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4776d-99e2-4787-a4e9-a72afe4d912c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:32.388905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ee02d-a3c8-4a46-9fa3-aeacadc006db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:32.389925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ee02d-a3c8-4a46-9fa3-aeacadc006db None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.390443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ee02d-a3c8-4a46-9fa3-aeacadc006db None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.390709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ee02d-a3c8-4a46-9fa3-aeacadc006db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.391452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ee02d-a3c8-4a46-9fa3-aeacadc006db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:32.392902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ee02d-a3c8-4a46-9fa3-aeacadc006db None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:32.417880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 452/918] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:32.909444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a407-d502-415f-ac54-8464e63bf6c8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.909854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a407-d502-415f-ac54-8464e63bf6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.910027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233a407-d502-415f-ac54-8464e63bf6c8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.911623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 467/919] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:32.917253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:32.917730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:32.917830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:32.935229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:32.936411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:32.948460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:33.015455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 453/920] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:33.037969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a407-d502-415f-ac54-8464e63bf6c8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:33.058587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:33.144510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233a407-d502-415f-ac54-8464e63bf6c8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:33.184003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:33.185130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:33.185634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:33.186121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:33.186991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:33.188536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:33.201086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:33.202078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:33.202962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:33.205731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 468/921] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:33.216008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:33.316055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212bbd6-bf8b-4ffe-9935-8b81aee5953b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:33.351245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:33.351911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:33.352262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:33.352533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:33.353238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:33.353541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:33.355137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:33.360869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 454/922] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:33.367611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:33.459677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:33.478792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1274c4a4-a47d-47df-b17e-4fba46ff0d76 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:33.512302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:33.513275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:33.513552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:33.513823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:33.514551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:33.514855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:33.516211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:33.521452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 469/923] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:33.527617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:33.537336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:33.632947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4669-6ac8-4e9a-a7ac-9b2547f09754 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:33.669088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:33.669789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:33.670076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:33.670350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:33.671213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] RBAC: Adding query filter params (interface=public, service_id=d430a6127557458c8d19799ecb35007e, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:33.671526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:33.672882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a4974d-1409-4334-a429-7eca941230e1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:33.678466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 455/924] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:33 2022] GET /identity/v3/endpoints?service_id=d430a6127557458c8d19799ecb35007e&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:33.684209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:33.787691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d0cbc-3c2b-4232-b19a-fff0d5da108c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:33.821932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375bdc-fad2-4c07-8d98-7b36545274d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:33.823017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375bdc-fad2-4c07-8d98-7b36545274d6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:33.823496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375bdc-fad2-4c07-8d98-7b36545274d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:33.823983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375bdc-fad2-4c07-8d98-7b36545274d6 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:33.824869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375bdc-fad2-4c07-8d98-7b36545274d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:33.826440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0375bdc-fad2-4c07-8d98-7b36545274d6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:33.833220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 470/925] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:33 2022] GET /identity/v3/services => generated 1497 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:45:34.295567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba345ad-7f2a-42b9-a026-851921afecb2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.296113 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba345ad-7f2a-42b9-a026-851921afecb2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.296113 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba345ad-7f2a-42b9-a026-851921afecb2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.297690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 456/926] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:34.303120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.303521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.303686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.320448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:34.321619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:34.325257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:34.342994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207130de-2a51-4a40-a276-e6f848e32dae None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.344062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207130de-2a51-4a40-a276-e6f848e32dae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.344566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207130de-2a51-4a40-a276-e6f848e32dae None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.346781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 457/927] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:34.352076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.352844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.353438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.371739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:34.373892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:34.403050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 471/928] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:34.426545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:34.452103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:34.460161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 458/929] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:34.482845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:34.546777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c23d09-fe96-4cce-b198-f6e5f6f565de None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:34.584779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61378d-3218-43c6-8a9e-1ea02e2a7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:34.585598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61378d-3218-43c6-8a9e-1ea02e2a7010 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.585875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61378d-3218-43c6-8a9e-1ea02e2a7010 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.586145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61378d-3218-43c6-8a9e-1ea02e2a7010 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.595638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:34.598602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61378d-3218-43c6-8a9e-1ea02e2a7010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:34.601928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115d502-4de7-41d8-beb8-d5667383ecf1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-9e61378d-3218-43c6-8a9e-1ea02e2a7010 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:34.607303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:34.608234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:34.609083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:34.614861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 472/930] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 09:45:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:34.616514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196ce06-ef58-4ac1-be78-93a8452a63f4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.616797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196ce06-ef58-4ac1-be78-93a8452a63f4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.617064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196ce06-ef58-4ac1-be78-93a8452a63f4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.622868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 473/931] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:34.622868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196ce06-ef58-4ac1-be78-93a8452a63f4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:34.643091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:34.644296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.644716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.644987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.645637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:34.647188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4f9ea3dd-7306-48e7-883a-29d4773448c7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:34.659546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:34.660488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:34.661367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 459/932] 10.222.0.17 () {56 vars in 1132 bytes} [Wed Jul 13 09:45:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:34.662213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.662822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.662822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.681283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:34.683023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:34.731285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196ce06-ef58-4ac1-be78-93a8452a63f4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:34.750691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:34.766503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 460/933] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:34.766503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:34.775740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:34.777038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.777346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.777680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.778812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:34.779129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:34.780815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:34.791518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 474/934] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:45:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:34.792375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:34.857615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:34.871631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e1615-32e3-4946-886c-e4ba1787e3a1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:34.902596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b800b715-ef02-45be-9734-a42c0e9f431a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:34.908295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:34.908851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.909131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.909404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.910098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:34.910402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:34.911760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:34.918195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 461/935] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:34.919190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:34.947002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:34.947891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:34.948175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:34.948566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:34.949309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:34.950829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:34.952260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING keystone.server.flask.common [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 09:45:34.971461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.sql.core [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 09:45:34.971461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 09:45:34.971461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [parameters: {'id': 'ffc2de5f3b434bc79e578b91a023cf9b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 09:45:34.971461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80222) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 09:45:34.985452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ffc2de5f3b434bc79e578b91a023cf9b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ffc2de5f3b434bc79e578b91a023cf9b. Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application conn.query(q) Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 09:45:34.987943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application result.read() Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 13 09:45:34.988797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application next(self.gen) Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application yield resource Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application next(self.gen) Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise self.value Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application session.commit() Jul 13 09:45:34.989821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.session.flush() Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application compat.raise_( Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 09:45:34.990859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 09:45:34.993112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application conn.query(q) Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application result.read() Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 09:45:34.996826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [parameters: {'id': 'ffc2de5f3b434bc79e578b91a023cf9b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:34.998746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:35.000410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ffc2de5f3b434bc79e578b91a023cf9b. Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 475/936] 10.222.0.17 () {60 vars in 1140 bytes} [Wed Jul 13 09:45:34 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:35.003282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.039617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e8f8a-4688-406b-9004-2b17bc83f54c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.079227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.080443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.080735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.081011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.092844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.094267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.096446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ab1637-0702-4976-9135-35c0826a16be None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:35.112325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:35.113272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:35.114166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:35.114166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:35.114166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:35.114166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:35.114166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 462/937] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:35.114998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.119138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:35.137721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.138757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.139008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.139281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.139979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:35.140279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.141831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.155276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 476/938] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:35.155276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.228652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4ee9e-bec6-43ab-968c-ec44c5d1d5e9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.240202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:35.266908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.267712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.267999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.268258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.274826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2858c-178e-4c8f-ae78-7d33f9097b29 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.277983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.279532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:35.295181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:35.296579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:35.297465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 463/939] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:35.297946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.318821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.319496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.319763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.320032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.320746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:35.321296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.322570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.334914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 477/940] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:35.335615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.387283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:35.415070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1040cf-5eb0-4089-bfb3-8720bbd5c3af None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.445688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4824496-15b4-494a-a658-78a0e480c7ff None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.450023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.450716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.450995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.451267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.451991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.453339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.478509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 464/941] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:35 2022] POST /identity/v3/endpoints => generated 347 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:35.478509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.492784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.493735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.494070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.494571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.495571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:35.496299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.498138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.526836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:35.533719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 478/942] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:35.609483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d63e-86c0-4998-977a-a2f0510be78f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.655337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.656060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.656339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.656607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.665713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.667527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:35.683695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:35.684766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:35.685769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 465/943] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:45:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:35.691047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.799592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:35.804385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c403ae9-ded2-44bf-b341-bb9287d577d1 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:35.842230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:35.842945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.843229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.843504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.844343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:35.844652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:35.846086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2587e0-6ed5-4f74-8504-5cf8e8d9c817 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:35.867657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 479/944] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 09:45:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:35.871094 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:35.886939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddec51-2d6c-4fd9-a33a-79a372d5be1b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.887262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddec51-2d6c-4fd9-a33a-79a372d5be1b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.887494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dddec51-2d6c-4fd9-a33a-79a372d5be1b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.889343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 480/945] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:35.894617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:35.894903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:35.895179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:35.915445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:35.917499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:35.967570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:35.984786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000fcf6-88b3-4234-900d-e167be9edde8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.007334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 481/946] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:36.025991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.027123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.027579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.028008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.030116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.042860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.044348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:36.067616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:36.068616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:36.069519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:36.069519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:36.069519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:36.069519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:36.074237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 466/947] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:36.075791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.131709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:36.149726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc5dde-4eb1-45a8-a8b6-766a67c57ab3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.195610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.196737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.197196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.197855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.198892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.200709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.209815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bd799-d7a1-41b0-a84c-03b163046177 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:36.214160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:36.215238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:36.216110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:36.223934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 482/948] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:36.225071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.250302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.251123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.251472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.251860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.252655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:36.253069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.254532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.262615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:36.275713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 467/949] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:36.276914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.339188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4e330-dc1d-49dd-a799-db4842d2dedc None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.375864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.376533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.376810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.377248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.377956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:36.378275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.379765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.388079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fcec04-cc0d-4165-99da-8408f98d2b86 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.390622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 483/950] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:36.392245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.409563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:36.425750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.426825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.427269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.427708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.435144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.436792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:36.451402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:36.452438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:36.453340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:36.460323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 468/951] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:36.461861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.503870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d0969-bbbf-4448-bbf6-519a4780f9b7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.522548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:36.542300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.543078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.543422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.543760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.544528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:36.544895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.546514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.556810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 484/952] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:36.558170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.570532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d307a-e0ae-4c11-9363-cd86b6692a52 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.605542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.606603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.607114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.607612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.608611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:36.609149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.610805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.628796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 469/953] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:36.630332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:36.644082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:36.669412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edd5c7-1d25-49a4-9dfb-4c25df8ba630 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.708852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387dcbe-cbf9-47e0-83f8-babda6b38aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.709539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387dcbe-cbf9-47e0-83f8-babda6b38aba None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.709816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387dcbe-cbf9-47e0-83f8-babda6b38aba None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.710086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387dcbe-cbf9-47e0-83f8-babda6b38aba None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.710851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387dcbe-cbf9-47e0-83f8-babda6b38aba None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.712292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387dcbe-cbf9-47e0-83f8-babda6b38aba None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.738497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 485/954] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:36 2022] POST /identity/v3/endpoints => generated 349 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:36.750411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f841a744-c13b-4259-a419-3d19c51a9228 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:36.776051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:36.804404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdfbc8-aeda-41b4-b84e-5ea90651a61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:36.805766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdfbc8-aeda-41b4-b84e-5ea90651a61d None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:36.806331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdfbc8-aeda-41b4-b84e-5ea90651a61d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:36.807005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdfbc8-aeda-41b4-b84e-5ea90651a61d None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ed4faddf2f4d4b6fa1d61c8a276724e2/roles/e5d2b52fa7bf4237a692f4ccbef1f702` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:36.809807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdfbc8-aeda-41b4-b84e-5ea90651a61d None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=ed4faddf2f4d4b6fa1d61c8a276724e2, role_id=e5d2b52fa7bf4237a692f4ccbef1f702)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:36.811698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdfbc8-aeda-41b4-b84e-5ea90651a61d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:36.838617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 470/955] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:36 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/ed4faddf2f4d4b6fa1d61c8a276724e2/roles/e5d2b52fa7bf4237a692f4ccbef1f702 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:45:37.632722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54d1f-078b-4260-ab26-2d582b59524a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:37.633261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54d1f-078b-4260-ab26-2d582b59524a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:37.633261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e54d1f-078b-4260-ab26-2d582b59524a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:37.634969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 486/956] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:37.640649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305594fe-f644-4d89-a1b9-881d4f530302 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:37.641050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305594fe-f644-4d89-a1b9-881d4f530302 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:37.641253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305594fe-f644-4d89-a1b9-881d4f530302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:37.658583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-305594fe-f644-4d89-a1b9-881d4f530302 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:37.659782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-305594fe-f644-4d89-a1b9-881d4f530302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:37.735006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 471/957] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:37.736713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a6b0-513d-4f69-8d28-ee98d92b5ff5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:37.737002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a6b0-513d-4f69-8d28-ee98d92b5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:37.737285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24a6b0-513d-4f69-8d28-ee98d92b5ff5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:37.738693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 487/958] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:37.743916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:37.744272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:37.744575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:37.758232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a6b0-513d-4f69-8d28-ee98d92b5ff5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:37.761905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:37.763433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:37.842550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 472/959] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:37.862166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:37.864489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24a6b0-513d-4f69-8d28-ee98d92b5ff5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:37.902088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:37.903306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:37.904241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:37.904518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:37.904784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:37.905439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:37.906835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:37.908805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:37.921135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:37.922373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:37.923320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:37.926540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 488/960] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:37.937327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:37.990276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fcb40-bd91-4f08-9a93-e24f9ac15956 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:38.030950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:38.031724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.032515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.032868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.033636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:38.035537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:38.037460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING keystone.server.flask.common [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 13 09:45:38.052894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.sql.core [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 09:45:38.052894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 09:45:38.052894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [parameters: {'user_id': '40afac7c644d4470a5d0109b81fe8e47', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 09:45:38.052894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80223) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 13 09:45:38.058691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86cb96-d1a6-4966-9a88-94cc0753c437 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 13 09:45:38.062849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 09:45:38.063752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application yield resource Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application next(self.gen) Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.rollback() Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.force_reraise() Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise self.value Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application session.commit() Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 13 09:45:38.064824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._prepare_impl() Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.session.flush() Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._flush(objects) Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application compat.raise_( Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application flush_context.execute() Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rec.execute(self) Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 13 09:45:38.066387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 13 09:45:38.067801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result = self._query(query) Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application conn.query(q) Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application result.read() Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 13 09:45:38.068859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [parameters: {'user_id': '40afac7c644d4470a5d0109b81fe8e47', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:38.070081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 13 09:45:38.079482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 473/961] 10.222.0.17 () {60 vars in 1131 bytes} [Wed Jul 13 09:45:37 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:38.080838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:38.100107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:38.100893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.101268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.101636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.102670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:38.103074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:38.104858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:38.114890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 489/962] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:38.116977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:38.183874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:38.199536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:38.208666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e43e3d-4d36-4223-a9cd-c5c93c6aac6a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:38.230192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdcb90a-8be6-4ede-848c-5be2d4cbb814 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:38.253782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:38.254913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.255220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.255494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.266404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:38.268105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:38.272965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:38.273739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.274114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.274762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.275733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:38.276163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:38.277616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b4e7178e-a8f4-4a60-ace2-e804c6f3c120 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:38.282699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:38.284745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 13 09:45:38.286956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:38.288206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 490/963] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:38.288363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 474/964] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:38.294551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:38.407801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c81f5-3616-4c5a-b295-854dd1904ae8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:38.437356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:38.446853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:38.447561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.447891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.448168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.449004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:38.449314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:38.452391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f8f890-0281-480c-a224-f4b62fd1c8a8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:38.489747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 491/965] 10.222.0.17 () {56 vars in 1101 bytes} [Wed Jul 13 09:45:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:38.896409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fad59-7110-46cf-b3c0-4e2a4e89b7d2 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.896992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fad59-7110-46cf-b3c0-4e2a4e89b7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.896992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fad59-7110-46cf-b3c0-4e2a4e89b7d2 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.901546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 475/966] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:38.906338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.906606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ae63-2181-4d9c-9fc7-08a33a1c9336 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.907072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.907246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ae63-2181-4d9c-9fc7-08a33a1c9336 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.907426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.907578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ae63-2181-4d9c-9fc7-08a33a1c9336 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.908545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 492/967] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:38.913421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:38.913838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:38.914119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:38.926515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:38.928007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:38.931407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:38.932721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:38.999385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 476/968] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:39.009270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 493/969] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:39.021782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.032345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.113567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:39.130183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b6093-76b4-4182-8929-5f6ee7138436 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.146063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea55441-e347-40bd-9abf-054b8acd1a9f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.161097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:39.168439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.169237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.169520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.169793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.170453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.171818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.183257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:39.183963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:39.184971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:39.185882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:39.187258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.187258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.187258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.190152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 477/970] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:39.191015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.196904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:39.205104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:39.206078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:39.206990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 494/971] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:39.212290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.300170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40df08d1-e1dd-4432-88c7-3bb272f2765b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.317485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8119d7-9788-4c31-af40-db84271e869c None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.335907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.336799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.337283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.337696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.338621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:39.339079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.340798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.346222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 478/972] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:39.351153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.351758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.351875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.352108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.352389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.353140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:39.353450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.354908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.371867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:39.374571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 495/973] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:39.379197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.419343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:39.474150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b325a04-e4d2-4c46-ba91-db8a6a5ea46c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.489835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a7c0a-2960-4613-b26e-1e7f04949264 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.511107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.512010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.512387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.512623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.513582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:39.513895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.515291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.520724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 479/974] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:39.525758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.526457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.526576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.526848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.527113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.538215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.539706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:39.557054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:39.558175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:39.559089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:39.559089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:39.559089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:39.559089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:39.559089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 496/975] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:39.563886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.611774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:39.636289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91347f-3775-4ad1-9d2d-5472164e8ee4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.653596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:39.666576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf318c9-498c-4a91-bad2-8b5843d54761 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.674032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.674738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.675016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.675291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.676164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] RBAC: Adding query filter params (interface=admin, service_id=d430a6127557458c8d19799ecb35007e, region_id=RegionOne) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:39.676380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.677716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.683414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 480/976] 10.222.0.17 () {56 vars in 1249 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/endpoints?service_id=d430a6127557458c8d19799ecb35007e&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:39.688845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.705762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.706320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.706619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.706920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.707599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:39.707900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.709388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.726547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 497/977] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:39.727495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.796676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485b66d-3dbe-4ca5-8228-ea5d6169322c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.832225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.832886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.833199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.833441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.834118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.835274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c026dcc-36ef-46af-a913-6e4667a1f971 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:39.835520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.841892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 481/978] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:45:39.874183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:39.875131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:39.875416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:39.875691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:39.884217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:39.886499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:39.904061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:39.905111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:39.906054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 498/979] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:39.911743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:39.925303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:40.029823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7bac1a-7862-4116-8c3b-f96fba54087b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:40.065092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:40.065770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.066058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.066336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.067216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:40.067528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:40.068957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e07b8f-f0ef-4a30-8d94-b81b812f465e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:40.087717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 482/980] 10.222.0.17 () {56 vars in 1149 bytes} [Wed Jul 13 09:45:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:40.093851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:40.105739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:40.200439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c16b0-71ff-45c1-8ea7-42b5a43618ae None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:40.235800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:40.236473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.236753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.237006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.305103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:40.306672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:40.317406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23b55-f7b6-4b8b-851e-9da1dcf0c0bd None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.317693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23b55-f7b6-4b8b-851e-9da1dcf0c0bd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.317957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b23b55-f7b6-4b8b-851e-9da1dcf0c0bd None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.319621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:40.319777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 483/981] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:40.324916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.325205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.325485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.342230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:40.343481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:40.406205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:40.418575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 484/982] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:40.434392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 499/983] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:40.439989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:40.440201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:40.552370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea393f1-aeca-48aa-9b73-e64fa0c70ec8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:40.553182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42d295-36af-4d8b-8c2f-426e2cb9077e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:40.562960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:40.591732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:40.592083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:40.592536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.592701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.592799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.592965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.593071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.593219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.593916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:40.595498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:40.604317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:40.605953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:40.610638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 485/984] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:40 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:40.625896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:40.627093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:40.628002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:40.628002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:40.628002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:40.628002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:40.628002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 500/985] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:40.639845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:40.702490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:40.764227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977ac57-47a8-4f43-af56-8cc2fdb20936 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:40.802307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:40.803077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.803308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.803590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.804321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:40.804633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:40.805998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:40.818789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 486/986] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:40.824898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:40.928570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd42f2-7f4f-4127-8f51-96e71e3496ba None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:40.965200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:40.966012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:40.966286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:40.966575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:40.973908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:40.975370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:40.989053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:40.989991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:40.991564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 501/987] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:40.998253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:41.099250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119fbc1-4e3f-471b-a03f-507210e31c0f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:41.110652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:41.135588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:41.136245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:41.136522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:41.136790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:41.137568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:41.138187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:41.139636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88b56ca-1a36-4eeb-91c2-b706d1bcd823 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:41.151972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 487/988] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:41.157788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:41.180516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:41.259112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd0715-f099-4c09-9cf4-5e3c485ba072 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:41.294745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:41.295373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:41.295650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:41.295916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:41.296735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] RBAC: Adding query filter params (role.id=e5d2b52fa7bf4237a692f4ccbef1f702, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=ed4faddf2f4d4b6fa1d61c8a276724e2) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:41.297041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:41.298465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8ab63-cd66-4a81-8edb-4e2aac82ea10 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:41.305741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 502/989] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:41 2022] GET /identity/v3/role_assignments?user.id=ed4faddf2f4d4b6fa1d61c8a276724e2&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=e5d2b52fa7bf4237a692f4ccbef1f702 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:41.877144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874482-a48f-4a40-9e24-03674dcaa90a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:41.877559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874482-a48f-4a40-9e24-03674dcaa90a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:41.877677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56874482-a48f-4a40-9e24-03674dcaa90a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:41.879258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 488/990] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:41.884298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:41.884583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:41.884939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:41.902565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:41.903719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:41.971734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 503/991] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:41.993940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874482-a48f-4a40-9e24-03674dcaa90a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:42.100573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56874482-a48f-4a40-9e24-03674dcaa90a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:42.134704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:42.135550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.135826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.136093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.136735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:42.138399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:42.150707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:42.152036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 13 09:45:42.152899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:42.154340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 489/992] 10.222.0.17 () {56 vars in 1126 bytes} [Wed Jul 13 09:45:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:42.157681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:42.174603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:42.267072 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb252f-92a0-4c55-bcce-37e856102c4d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:42.303490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:42.304163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.304444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.304716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.305425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:42.305729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:42.307674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:42.317272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 504/993] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:42.318637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:42.358473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:42.433366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb862567-2422-487a-827f-3cbfb8d58a98 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:42.468351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:42.469008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.469293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.469559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.470256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:42.470594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:42.471950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f972f9-2e7a-45d4-bbae-527cf1892350 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:42.477137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 490/994] 10.222.0.17 () {56 vars in 1122 bytes} [Wed Jul 13 09:45:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:42.484623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:42.565371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:42.588813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b677b8f-d643-49a2-9719-f0d00df83898 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:42.623480 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3800cbd-a7b1-4367-8169-f835fdc535a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:42.624129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3800cbd-a7b1-4367-8169-f835fdc535a5 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.624409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3800cbd-a7b1-4367-8169-f835fdc535a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.624676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3800cbd-a7b1-4367-8169-f835fdc535a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.625411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3800cbd-a7b1-4367-8169-f835fdc535a5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:42.626800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3800cbd-a7b1-4367-8169-f835fdc535a5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:42.643295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 505/995] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:42 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:42.645689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace08eb-3108-4b86-b8b1-2ef868d8d96f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.645984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace08eb-3108-4b86-b8b1-2ef868d8d96f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.646266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace08eb-3108-4b86-b8b1-2ef868d8d96f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.647843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 491/996] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:42.653551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.653896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.654180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.672689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:42.673925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:42.760249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 506/997] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:42 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:42.783549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace08eb-3108-4b86-b8b1-2ef868d8d96f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:42.888630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:42.893355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace08eb-3108-4b86-b8b1-2ef868d8d96f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:42.929180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:42.929986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:42.930270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:42.930577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:42.931235 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:42.932796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:42.944811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:42.945906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:42.947388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 492/998] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:42.952541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.020290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:43.064420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0ca9f-0426-4e89-8ea3-ef072325bab0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.100480 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.101143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.101427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.101703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.102470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:43.102809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.104277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.109761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 507/999] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:43.115622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.224916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01167172-7d6a-42ae-a5e5-6ce89aa6ea58 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.260262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.260928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.261212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.261487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.262194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:43.262540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.264300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cc3dc-d460-4db8-81ae-02e99e32b201 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.269449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 493/1000] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:43.275309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.344162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b59304-6030-4ac1-b125-d37bcc5621ec None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.344451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b59304-6030-4ac1-b125-d37bcc5621ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.344745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b59304-6030-4ac1-b125-d37bcc5621ec None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.346253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 494/1001] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:43.352283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.352555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.352836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.374567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:43.375798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:43.389292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72db7d-3c4f-430e-983d-8b178e381b12 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.401056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:43.420676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:43.429746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.430434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.430744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.431018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.431911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] RBAC: Adding query filter params (interface=public, service_id=21dc3f6e6ec94e7fb7594c1a3835945d, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:43.432222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.433598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.443373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 508/1002] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:43 2022] GET /identity/v3/endpoints?service_id=21dc3f6e6ec94e7fb7594c1a3835945d&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:43.444819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.453277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 495/1003] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:43.475299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.544854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90483cd4-44df-4270-beea-a76486e29cb4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.579714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.580384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.580654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.580928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.581638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.583036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.586346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca9745-0176-4285-ad26-75e98d105157 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.594453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 509/1004] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:43 2022] GET /identity/v3/services => generated 1727 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:45:43.624374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de872db-a148-4b73-930b-805840eac99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.625187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de872db-a148-4b73-930b-805840eac99d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.625474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de872db-a148-4b73-930b-805840eac99d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.625751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de872db-a148-4b73-930b-805840eac99d None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.626433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de872db-a148-4b73-930b-805840eac99d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.627858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de872db-a148-4b73-930b-805840eac99d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-9de872db-a148-4b73-930b-805840eac99d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:43.640913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:43.642002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:43.642920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 496/1005] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 13 09:45:43 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:43.648403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.711192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:43.762978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889c72-f3fc-4712-891d-02881b856778 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.800311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.800902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.801183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.801457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.802168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] RBAC: Adding query filter params (name=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:43.802506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.803877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0643cc4-8c78-4093-8627-f617cbf1a084 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.809154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 510/1006] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:43.815622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de872db-a148-4b73-930b-805840eac99d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:43.839119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:43.928866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de872db-a148-4b73-930b-805840eac99d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:43.965554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:43.966556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:43.967013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:43.967502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:43.968387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] RBAC: Adding query filter params (type=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:43.968865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:43.970400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a349a84-8ca9-45e7-92b4-94a018827aed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:43.975380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 497/1007] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:44.671435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e115-6d16-45ad-98f6-fcf745a5c7fa None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:44.671945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e115-6d16-45ad-98f6-fcf745a5c7fa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:44.671945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93e115-6d16-45ad-98f6-fcf745a5c7fa None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:44.673440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 511/1008] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:44.678518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:44.678952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:44.679032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:44.696338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:44.697581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:44.772337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 498/1009] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:44 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:44.795272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93e115-6d16-45ad-98f6-fcf745a5c7fa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:44.904011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93e115-6d16-45ad-98f6-fcf745a5c7fa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:44.925280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:44.941125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae3e33-43ba-4cf8-9c46-6961ab652f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:44.941937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae3e33-43ba-4cf8-9c46-6961ab652f02 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:44.942219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae3e33-43ba-4cf8-9c46-6961ab652f02 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:44.942525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae3e33-43ba-4cf8-9c46-6961ab652f02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:44.943691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae3e33-43ba-4cf8-9c46-6961ab652f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:44.945160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae3e33-43ba-4cf8-9c46-6961ab652f02 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:44.947082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 512/1010] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:44.952956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:44.969436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:45.057409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef3fe0-0faf-4060-95cc-45dc79bb7170 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:45.094630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65a591-e67c-41b6-a7cf-fe739fe0ccc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:45.095317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a591-e67c-41b6-a7cf-fe739fe0ccc4 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:45.095602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a591-e67c-41b6-a7cf-fe739fe0ccc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:45.095876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65a591-e67c-41b6-a7cf-fe739fe0ccc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:45.096596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65a591-e67c-41b6-a7cf-fe739fe0ccc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:45.098025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65a591-e67c-41b6-a7cf-fe739fe0ccc4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:45.130463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 499/1011] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:44 2022] POST /identity/v3/projects => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:45.650961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfdaec-641a-4138-ada9-e9454083c89a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:45.651162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfdaec-641a-4138-ada9-e9454083c89a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:45.651444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfdaec-641a-4138-ada9-e9454083c89a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:45.652844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 513/1012] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:45.658141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:45.658483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:45.658739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:45.676003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:45.677168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:45.737340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:45.747240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 500/1013] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:45.768864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfdaec-641a-4138-ada9-e9454083c89a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:45.871681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfdaec-641a-4138-ada9-e9454083c89a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:45.906898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:45.907660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:45.907936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:45.908203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:45.908843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:45.910195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-00ab21e1-141e-4190-94f6-eed00012e66b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:45.922380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:45.923409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 13 09:45:45.924251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:45.926505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 514/1014] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:45.929897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:45.969818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c0f3-a335-4f7f-b64c-3d252e38e669 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:45.970167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c0f3-a335-4f7f-b64c-3d252e38e669 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:45.970403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8c0f3-a335-4f7f-b64c-3d252e38e669 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:45.972217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 515/1015] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:45.976881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:45.977205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:45.977455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:45.995030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:45.996212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:46.037079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a3f42-4c37-4e82-80e1-c153cb44ccf5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:46.047498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:46.069010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 516/1016] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:45 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:46.081494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:46.082242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:46.082619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:46.082959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:46.083737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:46.084147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:46.085607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:46.094488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 501/1017] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:45 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:46.096008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:46.096526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:46.160092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:46.200904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba31eb-5d93-4345-93fe-092ed21ff910 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:46.202498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562c214-b128-48c2-b384-f63b067719c7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:46.235759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab9f77c-efe8-40dd-8413-da1fde49cbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:46.236426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9f77c-efe8-40dd-8413-da1fde49cbb9 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:46.236703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9f77c-efe8-40dd-8413-da1fde49cbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:46.236974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab9f77c-efe8-40dd-8413-da1fde49cbb9 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:46.237691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9f77c-efe8-40dd-8413-da1fde49cbb9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:46.238466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:46.239081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab9f77c-efe8-40dd-8413-da1fde49cbb9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:46.239196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:46.239414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:46.239688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:46.240392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:46.240701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:46.242060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:46.252917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 502/1018] 10.222.0.17 () {56 vars in 1112 bytes} [Wed Jul 13 09:45:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:46.254271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:46.262508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 517/1019] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:45:46 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:46.382902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f3407-1cee-49da-aacf-1bf7fbfe8165 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:46.412461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:46.430535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610b945-8a40-4246-8199-a55b1f6c2595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:46.431195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610b945-8a40-4246-8199-a55b1f6c2595 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:46.431714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610b945-8a40-4246-8199-a55b1f6c2595 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:46.432272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610b945-8a40-4246-8199-a55b1f6c2595 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:46.433030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610b945-8a40-4246-8199-a55b1f6c2595 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:46.433999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610b945-8a40-4246-8199-a55b1f6c2595 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:46.453406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 503/1020] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:46 2022] POST /identity/v3/endpoints => generated 334 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:45:47.195597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450376c-16c9-4109-9916-69e4a3af221c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:47.196224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450376c-16c9-4109-9916-69e4a3af221c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:47.196224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450376c-16c9-4109-9916-69e4a3af221c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:47.198460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 518/1021] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:47.203461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:47.203858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:47.204056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:47.221686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:47.222999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:47.303307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 504/1022] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:47.328012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450376c-16c9-4109-9916-69e4a3af221c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:47.380864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:47.445883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450376c-16c9-4109-9916-69e4a3af221c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:47.482742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225822bd-9e13-4357-9374-9e72f9e9e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:47.483887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225822bd-9e13-4357-9374-9e72f9e9e6fe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:47.484371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225822bd-9e13-4357-9374-9e72f9e9e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:47.484842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225822bd-9e13-4357-9374-9e72f9e9e6fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:47.486233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225822bd-9e13-4357-9374-9e72f9e9e6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:47.487890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225822bd-9e13-4357-9374-9e72f9e9e6fe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:47.490176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 519/1023] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:47.495997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:47.600871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf5d85-b706-441b-b02b-ade0047cb61a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:47.602459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:47.638767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a435d-9002-4f21-a674-5933f50156a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:47.639438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a435d-9002-4f21-a674-5933f50156a4 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:47.639710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a435d-9002-4f21-a674-5933f50156a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:47.639980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a435d-9002-4f21-a674-5933f50156a4 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:47.640683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a435d-9002-4f21-a674-5933f50156a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:47.642122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a435d-9002-4f21-a674-5933f50156a4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:47.670444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 505/1024] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:45:47 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:48.357860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb27d9-cec6-4320-8829-6f8c1b7c330c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.358401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb27d9-cec6-4320-8829-6f8c1b7c330c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.358401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb27d9-cec6-4320-8829-6f8c1b7c330c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.359979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 520/1025] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:48.371755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df9deb-aff2-430d-a42d-4c807fba9bcc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.372141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df9deb-aff2-430d-a42d-4c807fba9bcc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.372303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df9deb-aff2-430d-a42d-4c807fba9bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.390283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-38df9deb-aff2-430d-a42d-4c807fba9bcc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:48.391674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-38df9deb-aff2-430d-a42d-4c807fba9bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:48.465738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 506/1026] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:48.488326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb27d9-cec6-4320-8829-6f8c1b7c330c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:48.565645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163444e-0b29-44a0-990d-74a68da3664b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.565893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163444e-0b29-44a0-990d-74a68da3664b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.566199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163444e-0b29-44a0-990d-74a68da3664b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.567775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 507/1027] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:48.572582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.572833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.573146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.590890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:48.591527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb27d9-cec6-4320-8829-6f8c1b7c330c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:48.592034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:48.603045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:48.627408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:48.628124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.628401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.628671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] PATH_INFO: `/v3/services/image` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.629312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:48.630698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:48.642628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:48.643599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:48.644521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:48.648869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 521/1028] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 13 09:45:48 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:48.649735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:48.669543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 508/1029] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:48.692712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:48.712054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:48.764856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117802-a8a3-427a-a76a-732fb09d1e27 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:48.802271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:48.802970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.803255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.803535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.804243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] RBAC: Adding query filter params (name=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:48.804411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52e756-e4f6-43be-99fe-2412260ab246 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:48.804578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:48.806027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:48.816246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 522/1030] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:48.817256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:48.846738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:48.847669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.848065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.848343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.860063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:48.860443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:48.869476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:48.870499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:48.871398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 509/1031] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 09:45:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:48.876742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:48.926387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688fcd-e810-430a-ba6d-d03951215c7a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:48.956596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:48.962107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:48.962850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:48.963134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:48.963408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:48.964118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] RBAC: Adding query filter params (type=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:48.964425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:48.965795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:48.970724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 523/1032] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:48.976402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:48.985147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13619a5-f6c5-454f-9b9b-db741fa341d5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.020571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.021285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.021571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.021846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.022618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:49.022931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.024298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.032798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 510/1033] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:45:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:49.038480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.086908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696cbfc-7c22-4fa9-a455-ab796d69f0ec None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.088899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:49.124483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.124950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.125226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.125498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.126408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] RBAC: Adding query filter params (interface=public, service_id=f16e7fdd34d94b11a28c89127c7f9cdb, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:49.126750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.128123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.133540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 524/1034] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:45:48 2022] GET /identity/v3/endpoints?service_id=f16e7fdd34d94b11a28c89127c7f9cdb&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:49.139234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.148080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd39e4c-b593-4593-81b6-ec32717d1569 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.182599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.183316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.183597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.183871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.193967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:49.196524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.199517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:49.217777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:49.219003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:49.225323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:49.225323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:49.225323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:49.225323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:49.225323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 511/1035] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:49.225323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.253070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637bc8f-ccc4-4410-bb14-a224034235ec None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.287752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.288424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.288705 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.288989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.289671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.291406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.298263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 525/1036] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/services => generated 1957 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:45:49.338006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e250c221-1a2c-43e0-b8fa-874f2be763df None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.378797 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.379563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.379770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.380045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.380779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:49.381089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.382631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.402003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 512/1037] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:49.403156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.438013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:49.513337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37406dd5-52e4-4a33-b39d-feaa9982b5e5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.548209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.549005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.549287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.549559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.557590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.559063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-70699658-cf5f-4b89-9560-fba9726c7743 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:49.573341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:49.574327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:49.575463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 526/1038] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:49.581826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.649111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:49.706825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73878121-6c85-42eb-a8a1-76f189f61a73 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.741702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.742544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.742920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.743287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.744478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:49.744956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:49.745878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471641-27be-4f80-9c8f-207ad48b8697 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.746166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471641-27be-4f80-9c8f-207ad48b8697 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.746469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf471641-27be-4f80-9c8f-207ad48b8697 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.746708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:49.752026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 527/1039] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:45:49.753044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.753335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.753621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.773027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:49.774194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:49.776403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 513/1040] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:49.783429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.847292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 528/1041] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:49.870507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:49.897144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:49.904686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d0bff-e501-4969-81d3-66bce4d0bc9b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:49.916984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:49.948491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:49.949159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:49.949438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:49.949709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:49.986865 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c29f7-86c6-47e0-9209-406f05c80bd5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.031224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.032663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.033114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.033738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.046962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:50.049735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.052064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:50.056972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:50.058132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:50.059195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:50.062146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 529/1042] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:50.070607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.157244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.164354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 514/1043] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:50.170394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.178091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5674d-5eb6-4c53-bb44-8949cae4bbeb None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.185231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.212815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.213767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.214057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.214336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.215120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:50.215431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.217143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.230597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 530/1044] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:50.231653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.290510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d98c3-1fcf-480d-a865-b42ffe40ea03 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.328011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.328806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.329090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.329364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.340191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.340366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eab2ca-97d4-428d-af38-bbbaac23323e None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.341626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:50.359697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:50.360629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:50.362405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:50.362405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:50.362405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:50.362405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:50.362405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 515/1045] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:50.366601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.381795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.382717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.382994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.383263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] PATH_INFO: `/v3/users/80a64ece87a14b23a4e76eac860de526` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.396246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.399966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] RBAC: Authorizing `identity:get_user(user_id=80a64ece87a14b23a4e76eac860de526)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.401827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.408530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 531/1046] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/users/80a64ece87a14b23a4e76eac860de526 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:50.409983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.437268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.485177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe627d-21d7-4d23-8803-ac7f6a24409a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.520183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad3d625-08e3-4a87-a5ea-ab0ab0566c78 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.522472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.523134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.523414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.523686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.524391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:50.524690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.526141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.538720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 516/1047] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:50.544334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.560036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.560698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.560980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.561245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.631298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.633981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.635861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.652050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5ff20-6a87-4953-a4a7-b986ee6f7a98 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.677910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.690996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.691792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.692075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.692353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.699356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.700794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:50.714982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:50.716070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:50.717090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 517/1048] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:50.721834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.742233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 532/1049] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:50.749270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.831887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f29444-8d84-4588-bdc5-cf31d525a5fa None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.854406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:50.857735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f88717-4270-49c3-aae2-1832d233032b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:50.868980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.869704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.869988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.870302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.871081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:50.871389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.873080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.891185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 518/1050] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:50.892439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.895725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:50.896708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:50.896987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:50.897259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:50.898711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] RBAC: Authorizing `identity:get_project(project_id=389460c8ae004cc5a088fd96df37f941)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:50.900469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:50.907420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 533/1051] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/projects/389460c8ae004cc5a088fd96df37f941 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:50.909025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:50.942994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:51.007456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3c0ce-f66b-4477-a648-08596d0822f5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:51.031019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f3ed4-b015-4019-94af-56683e3c527f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:51.045139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:51.046374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.046897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.047182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.048019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] RBAC: Adding query filter params (role.id=e5d2b52fa7bf4237a692f4ccbef1f702, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=339f9bc083674bf897023509101fc7dc) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:51.048336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:51.049752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e1853-9a6b-4e26-81e5-bbf8d798b7c0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:51.055542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 519/1052] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/role_assignments?user.id=339f9bc083674bf897023509101fc7dc&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=e5d2b52fa7bf4237a692f4ccbef1f702 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:51.076430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:51.077112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.077395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.077679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.078570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=389460c8ae004cc5a088fd96df37f941, user.id=80a64ece87a14b23a4e76eac860de526) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:51.078886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:51.080363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5722490c-c3ed-467b-b91b-1ac1ce760291 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:51.087266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 534/1053] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:50 2022] GET /identity/v3/role_assignments?user.id=80a64ece87a14b23a4e76eac860de526&scope.project.id=389460c8ae004cc5a088fd96df37f941&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:51.349066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938369d-e13a-42db-b23a-6ee35ab0a30c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.349253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938369d-e13a-42db-b23a-6ee35ab0a30c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.349486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938369d-e13a-42db-b23a-6ee35ab0a30c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.351137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 520/1054] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:51.356185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.356433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.356731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.376717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:51.377892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:51.406847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:51.450938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 535/1055] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:51.473241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938369d-e13a-42db-b23a-6ee35ab0a30c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:51.588908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a938369d-e13a-42db-b23a-6ee35ab0a30c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:51.596313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:51.627099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:51.627805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.628085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.628360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] PATH_INFO: `/v3/services/image` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.629019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:51.630451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:51.643243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:51.644256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:51.650500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 521/1056] 10.222.0.17 () {56 vars in 1105 bytes} [Wed Jul 13 09:45:51 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:51.653093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:51.758759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11707d3b-8c9c-43a3-9d31-85bdf748f080 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:51.794269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:51.794968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.795250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.795517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.796217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:51.796515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:51.797887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:51.803116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 536/1057] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:51 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:51.808709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:51.910022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b343b-4fe8-4ca5-adcb-d10f173c3029 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:51.942833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:51.943485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:51.943760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:51.944032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:51.944724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] RBAC: Adding query filter params (type=image) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:51.945023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:51.946371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47172ac1-149f-46c9-a148-78187c156e10 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:51.951611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 522/1058] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:51.957172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:51.985812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:52.063457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ac390-cac8-4bca-a018-65fd1e55cfd6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:52.098687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7f1cc-d047-446b-950f-24d017b1250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:52.099402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7f1cc-d047-446b-950f-24d017b1250f None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:52.099687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7f1cc-d047-446b-950f-24d017b1250f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:52.099983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7f1cc-d047-446b-950f-24d017b1250f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:52.100759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7f1cc-d047-446b-950f-24d017b1250f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:52.102137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7f1cc-d047-446b-950f-24d017b1250f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:52.124903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 537/1059] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:45:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:45:53.088866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20c106-5ab6-497b-8db4-3027b9574d81 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.089411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20c106-5ab6-497b-8db4-3027b9574d81 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.089411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c20c106-5ab6-497b-8db4-3027b9574d81 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.091966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 523/1060] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:53.096695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.097115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d65b03-205e-4040-a35b-ed91d1c92fca None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.097196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.097268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d65b03-205e-4040-a35b-ed91d1c92fca None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.097359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.097443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d65b03-205e-4040-a35b-ed91d1c92fca None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.098730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 524/1061] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:53.103452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.103734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.104014 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.117073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:53.118282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:53.120441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:53.121895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:53.151573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.196101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 538/1062] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:53.196630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 525/1063] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:45:53.218402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.221254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.230395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.329580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746f2df-0555-4cba-a9d1-f8d52e76eaec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.333740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83cec8f-110b-4d4d-a386-fb4e78caee30 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.368805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.369882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.370290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.370612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.380671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.381490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.381746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:53.381863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.382030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:53.390141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:53.391120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:53.391973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 526/1064] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:53.395973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:53.397452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:53.404674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:53.405623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:53.407354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:53.410993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 539/1065] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:53.412077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.426588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.482091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.511753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5a147-bf72-438c-bf4e-8bb506ba288c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.518565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b2d0b-f8d4-4b87-ac93-d3efe2528d55 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.547736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.548408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.548693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.549107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.549711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:53.550020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:53.551417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:53.554030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.554725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.555011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.555286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.556036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:53.556489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:53.557936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:53.560283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 527/1066] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:53.566128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.566708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 540/1067] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:53.572157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.657224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.674082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cd6c4-82fb-43c4-b52e-b3dc76906da5 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.677911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc8b13-2f29-4b8a-a085-bb39465ad21a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.709433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.710462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.711414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.711736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.712017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] PATH_INFO: `/v3/users/80a64ece87a14b23a4e76eac860de526` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.713468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] RBAC: Authorizing `identity:get_user(user_id=80a64ece87a14b23a4e76eac860de526)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:53.715103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:53.717084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 528/1068] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/users/80a64ece87a14b23a4e76eac860de526 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:53.717464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.718269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.718587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.718867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.722575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.732910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:53.734759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:53.757349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:53.758288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:53.759222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:53.759222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:53.759222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:53.759222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:53.759542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 541/1069] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:53.765278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.831052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c31498-baf7-40d4-a1c7-915407058a8d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.866589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.867550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.867841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.868122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.869443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=389460c8ae004cc5a088fd96df37f941)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:53.870618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aed3be6-ca57-47d7-bc4b-a90c47e78b45 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:53.871020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:53.873066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 529/1070] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/projects/389460c8ae004cc5a088fd96df37f941 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:53.879497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.905361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.915123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:53.915752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:53.916199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:53.916479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:53.917989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:53.918300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:53.919706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:53.934565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 542/1071] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:53.940314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:53.985992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:53.994473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a35c74-5abc-4d5b-8239-2d868255c4a2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.035317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.036220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.036534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.036788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941/users/80a64ece87a14b23a4e76eac860de526/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.038902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=389460c8ae004cc5a088fd96df37f941, user_id=80a64ece87a14b23a4e76eac860de526, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.040368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.047947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1163b7c5-f8d9-4215-adb5-7783c15c56f2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.057083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 530/1072] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:53 2022] PUT /identity/v3/projects/389460c8ae004cc5a088fd96df37f941/users/80a64ece87a14b23a4e76eac860de526/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:45:54.090618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.091781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.092258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.092708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.101275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.103555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-26ebe86c-5244-485e-baac-d071dd48594f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:54.120032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:54.121059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:54.122400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:54.122971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 543/1073] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:45:54.129956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.218565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731987a-7ea3-47ff-8581-673c6c4d9d88 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.218893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731987a-7ea3-47ff-8581-673c6c4d9d88 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.219214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731987a-7ea3-47ff-8581-673c6c4d9d88 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.220711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 544/1074] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:54.226310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.226614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.226885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.235566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:54.246384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:54.247722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:54.254100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d67a1-d3cc-48d2-9c6f-4e313e9860e9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.289411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.290081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.290358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.290795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.291623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:54.291927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.293349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.316241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 531/1075] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:54.317282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.325545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 545/1076] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:54.347406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.390689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:54.446992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939e4618-ead0-4729-9916-5e02570cb5ed None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.466564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2370ee2-eeb5-41e3-8eec-e58d37378c31 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.483636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.484362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.484641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.484913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.494250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:54.496560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.498124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.503275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.503930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.504206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.504476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:54.519062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:54.520052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:54.520951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:54.520951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:54.520951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:54.520951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:54.520951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 532/1077] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:54.525861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.584095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.585580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.616753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:54.636096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ff318-673a-4cd8-a086-81838e32ccc3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.672817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.673855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.673855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.674068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.674743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:54.675061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.676428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.688891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 533/1078] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:45:54.694240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.700047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 546/1079] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 09:45:54.700984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.754205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:54.805870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa43d4-6b6d-4c15-a765-ead32a52734f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.812551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea3a43-443a-4458-89e9-8986c6129392 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:54.842283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.843120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.843412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.843689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.843970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:54.849700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:54.850751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:54.851228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:54.851692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:54.851808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.853211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.863369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:54.865018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:54.867730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:54.868664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:54.869876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 534/1080] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:54.874930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:54.889141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:54.890095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:54.891052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:54.891052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:54.891052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:54.891052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:54.891052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 547/1081] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:54.896876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:54.990570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2941e3-5045-45e3-a332-ea479a6b35c1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:55.005866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:55.010749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350b97e-ea51-4917-9ada-d2deda8303b6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:55.032567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:55.033585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:55.034049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:55.034502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:55.035434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:55.036011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:55.037889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:55.047175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:55.047851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:55.048133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:55.048409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:55.049134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:55.049442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:55.050847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731ac39-6747-4131-b7f9-819c4fd56d1a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:55.052907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 535/1082] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:55.059374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:55.070091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 548/1083] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:55.184319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc43437-f906-4c34-bd8e-102a930e2f68 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:55.222173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad909c2-46ce-436b-bf38-b7c714db47d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:55.223106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad909c2-46ce-436b-bf38-b7c714db47d0 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:55.223358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad909c2-46ce-436b-bf38-b7c714db47d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:55.223650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad909c2-46ce-436b-bf38-b7c714db47d0 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/339f9bc083674bf897023509101fc7dc/roles/e5d2b52fa7bf4237a692f4ccbef1f702` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:55.225977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad909c2-46ce-436b-bf38-b7c714db47d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=339f9bc083674bf897023509101fc7dc, role_id=e5d2b52fa7bf4237a692f4ccbef1f702)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:55.227431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad909c2-46ce-436b-bf38-b7c714db47d0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:55.243217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 536/1084] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:45:55 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/339f9bc083674bf897023509101fc7dc/roles/e5d2b52fa7bf4237a692f4ccbef1f702 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:45:56.077753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88100c-db6c-4c70-8ee7-5c7567b24588 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:56.078381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88100c-db6c-4c70-8ee7-5c7567b24588 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:56.078381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea88100c-db6c-4c70-8ee7-5c7567b24588 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:56.079730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 549/1085] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:56.085163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc54c-7269-4783-b90f-50e831609344 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:56.085461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc54c-7269-4783-b90f-50e831609344 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:56.085743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fc54c-7269-4783-b90f-50e831609344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:56.103715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-495fc54c-7269-4783-b90f-50e831609344 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:56.104898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-495fc54c-7269-4783-b90f-50e831609344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:56.131589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:56.175142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 537/1086] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:56.199099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88100c-db6c-4c70-8ee7-5c7567b24588 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:56.249983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:56.310692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea88100c-db6c-4c70-8ee7-5c7567b24588 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:56.346553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:56.347359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:56.347640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:56.347912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:56.359984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:56.368165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:56.369233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:56.370245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 550/1087] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:45:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:56.375983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc54c-7269-4783-b90f-50e831609344 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:56.479795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fc54c-7269-4783-b90f-50e831609344 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:56.516355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:56.517015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:56.517295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:56.517569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:56.518318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:56.518651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:56.520016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:56.528872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 538/1088] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:45:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:56.534775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:56.639083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb6275d-abd7-4d8f-b448-7d3163101a81 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:56.641390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:56.675994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:56.676876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:56.677153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:56.677430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] PATH_INFO: `/v3/users/80a64ece87a14b23a4e76eac860de526` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:56.678676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] RBAC: Authorizing `identity:get_user(user_id=80a64ece87a14b23a4e76eac860de526)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:56.680116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:56.682233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 551/1089] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:45:56 2022] GET /identity/v3/users/80a64ece87a14b23a4e76eac860de526 => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:56.687992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:56.715951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:56.795646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ff13c-3979-4bc7-a235-77ffbc1fdb98 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:56.830972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:56.831623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:56.831900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:56.832173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:56.901782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:56.903171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:56.927940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:57.006906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 539/1090] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:57.013257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:57.115319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03b7a4-b3c2-4c31-8c4e-e2ffbc073e6d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:57.150985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83baf847-e54b-4462-91a4-522b75c71ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:57.151899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf847-e54b-4462-91a4-522b75c71ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.152113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf847-e54b-4462-91a4-522b75c71ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.152372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83baf847-e54b-4462-91a4-522b75c71ff9 None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.153559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf847-e54b-4462-91a4-522b75c71ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=389460c8ae004cc5a088fd96df37f941)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:57.155038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83baf847-e54b-4462-91a4-522b75c71ff9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:57.156736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 552/1091] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:45:57 2022] GET /identity/v3/projects/389460c8ae004cc5a088fd96df37f941 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:57.162948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:57.252431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32faa9-49b5-4657-8cb2-e40608fd6025 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.252697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32faa9-49b5-4657-8cb2-e40608fd6025 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.252966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd32faa9-49b5-4657-8cb2-e40608fd6025 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.254340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 553/1092] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:57.260062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.260343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.260613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.267141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36986cd1-4b2e-4155-bb67-f91f7677d774 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:57.278134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:57.279355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:57.291340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:57.303435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:57.304095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.304379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.304660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.305488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=389460c8ae004cc5a088fd96df37f941, user.id=80a64ece87a14b23a4e76eac860de526) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:57.305807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:57.307331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:57.313410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 540/1093] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:57 2022] GET /identity/v3/role_assignments?user.id=80a64ece87a14b23a4e76eac860de526&scope.project.id=389460c8ae004cc5a088fd96df37f941&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:57.316720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:57.353007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 554/1094] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:57.377032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:57.493234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce328302-73d3-45df-b3de-6cba8297c60f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:57.528767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:57.529852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.530131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.530400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.541057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:45:57.549081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:57.550071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:57.550953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 541/1095] 10.222.0.17 () {56 vars in 1120 bytes} [Wed Jul 13 09:45:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:57.556433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:57.659163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d282755e-0782-4dc9-91ab-2016e564b198 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:57.694732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:57.695401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.695685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.695949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.696732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:57.697034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:57.698624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:57.707030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 555/1096] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:45:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:57.712952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:57.764713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:57.819563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d39ef2-074d-42cb-943f-1a18c566add0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:57.854173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:57.855044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:57.855323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:57.855596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:57.866628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:57.868046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:57.885294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:57.886223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:57.887180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:57.887180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:57.887180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:57.887180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:57.887180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 542/1097] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:57.892679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:57.925420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:57.995210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8ca33-5c76-4f9a-ad55-b1a4a042da97 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:58.030496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:58.031074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:58.031349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:58.031620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:58.032333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:58.032629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:58.033993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:58.046652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 556/1098] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:58.052346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:58.154704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:58.157980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a94d0-cc6e-4285-b226-02aea01d8531 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:58.192305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:58.193107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:58.193393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:58.193653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:58.201231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:58.202701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:45:58.216640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:58.217755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:45:58.223919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 543/1099] 10.222.0.17 () {56 vars in 1093 bytes} [Wed Jul 13 09:45:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:58.224933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:58.320482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:58.330368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8c0a6b-2e68-4525-9bf4-9e6213812f49 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:58.367633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:58.367633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:58.367633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:58.367633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:58.368535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:58.368535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:58.369885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:58.388443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 557/1100] 10.222.0.17 () {56 vars in 1133 bytes} [Wed Jul 13 09:45:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:58.394299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:58.503731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b672f7-c774-49d3-b117-3d6dc2138cd4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:58.539304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:58.539947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:58.540223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:58.540545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:58.568769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:58.609739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:58.611149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:58.711678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 544/1101] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:45:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:45:58.718228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:58.821529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e257bed2-b137-41fe-a28e-cbc1302fe34d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:58.856527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:58.857317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:58.857604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:58.857879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:58.868699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:58.870272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:45:58.888490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:58.889423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:58.890881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:45:58.890881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:45:58.890881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:45:58.890881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:58.890881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 558/1102] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:58.895650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:58.956903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:59.000450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a96082-8aae-41e1-a3ef-b8b623ba62ac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:59.037862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:59.038561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.038842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.039109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.039836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:59.040140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:59.042136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:59.054338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 545/1103] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:59.060055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:59.063128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:59.164411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f5446-0198-4244-8238-7c1e67c29e8d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:59.199373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:59.200156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.200432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.200697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.207551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:59.208985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:45:59.222876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:45:59.223795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:45:59.224683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 559/1104] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:45:59.230048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:59.331571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1f42d9-7684-44ce-a0df-11655032036e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:59.351765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:59.371002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:59.371515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.371791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.372062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.372851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:59.373155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:59.374597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4f5718-712c-4e3f-b499-743820e3b1fe None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:59.388122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 546/1105] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:45:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:59.394134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:59.402183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbce5a-89f7-444b-a6ae-ce25bd8eec24 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.402695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbce5a-89f7-444b-a6ae-ce25bd8eec24 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.402779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbce5a-89f7-444b-a6ae-ce25bd8eec24 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.404143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 547/1106] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:45:59.409039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.409326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.409602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.427426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:45:59.428553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:45:59.468286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:59.508036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 548/1107] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:45:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:45:59.510443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868f1f9-8d65-4c4d-a256-990c556899d2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:59.532924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:59.545460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:59.546122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.546406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.546706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.547565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] RBAC: Adding query filter params (role.id=e5d2b52fa7bf4237a692f4ccbef1f702, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=339f9bc083674bf897023509101fc7dc) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:45:59.547876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:59.549316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:59.555394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 560/1108] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:45:59 2022] GET /identity/v3/role_assignments?user.id=339f9bc083674bf897023509101fc7dc&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=e5d2b52fa7bf4237a692f4ccbef1f702 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:59.646674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d83ed4-e3b1-485b-ad4c-790e9ca58809 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:59.658448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:59.684123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c46cf-d8db-4e9f-ac9e-a33f2f3cfdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:59.684836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c46cf-d8db-4e9f-ac9e-a33f2f3cfdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.685116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c46cf-d8db-4e9f-ac9e-a33f2f3cfdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.685386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c46cf-d8db-4e9f-ac9e-a33f2f3cfdd8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.686603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c46cf-d8db-4e9f-ac9e-a33f2f3cfdd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:59.688033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c46cf-d8db-4e9f-ac9e-a33f2f3cfdd8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:59.689689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 549/1109] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:45:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:45:59.695754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:45:59.805241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18e554-c216-4e3b-86f1-f203634fbc2a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:45:59.835741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:45:59.845547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec733a-574c-455e-843c-e70814b7aaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:45:59.846229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec733a-574c-455e-843c-e70814b7aaf9 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:45:59.846542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec733a-574c-455e-843c-e70814b7aaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:45:59.846842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec733a-574c-455e-843c-e70814b7aaf9 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:45:59.847583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec733a-574c-455e-843c-e70814b7aaf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:45:59.849241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ec733a-574c-455e-843c-e70814b7aaf9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:45:59.870388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 561/1110] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:45:59 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:46:01.916745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2190fb3-3e0c-4040-a77c-f8b9ddaf668c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:01.917637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2190fb3-3e0c-4040-a77c-f8b9ddaf668c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:01.917637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2190fb3-3e0c-4040-a77c-f8b9ddaf668c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:01.919869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 550/1111] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:01.926037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:01.926799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:01.926935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:01.952537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:01.953734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:02.026125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 562/1112] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:02.050071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2190fb3-3e0c-4040-a77c-f8b9ddaf668c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:02.163722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2190fb3-3e0c-4040-a77c-f8b9ddaf668c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:02.199245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:02.200025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:02.200303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:02.200585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] PATH_INFO: `/v3/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:02.202162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] RBAC: Authorizing `identity:get_role(role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:02.203544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:02.204928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 551/1113] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:02 2022] GET /identity/v3/roles/8835b245e6e44fbb929afd739098a927 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:02.211257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:02.317157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1dd074-39f6-4ba3-8eaa-e0e15f697e3b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:02.331098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:02.359335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:02.360606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:02.360965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:02.361309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] PATH_INFO: `/v3/users/47d38615155540459e34fab5882e170b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:02.376308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] RBAC: Authorizing `identity:get_user(user_id=47d38615155540459e34fab5882e170b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:02.377771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:02.379524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 563/1114] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:02 2022] GET /identity/v3/users/47d38615155540459e34fab5882e170b => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:02.385630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:02.437314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:02.497969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319afb2b-8f4d-45b3-b210-393182d17dcc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:02.534018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:02.534679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:02.534958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:02.535228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:02.604037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:02.605466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:02.659063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:02.716306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 552/1115] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:46:02.722767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:02.830259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64888624-d54e-493d-a133-ba0a5a94998f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:02.866285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63531c7b-186c-4eab-8e84-64066795171e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:02.867122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531c7b-186c-4eab-8e84-64066795171e None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:02.867434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531c7b-186c-4eab-8e84-64066795171e None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:02.867709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63531c7b-186c-4eab-8e84-64066795171e None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:02.869032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63531c7b-186c-4eab-8e84-64066795171e None admin] RBAC: Authorizing `identity:get_project(project_id=389460c8ae004cc5a088fd96df37f941)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:02.870463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63531c7b-186c-4eab-8e84-64066795171e None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:02.872311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 564/1116] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:02 2022] GET /identity/v3/projects/389460c8ae004cc5a088fd96df37f941 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:02.878744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:02.991915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ea4156-27a6-4553-a958-b09c6d2c27b7 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:03.028635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:03.029272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:03.029549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:03.029823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:03.030665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] RBAC: Adding query filter params (role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=389460c8ae004cc5a088fd96df37f941, user.id=47d38615155540459e34fab5882e170b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:03.030975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:03.032749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c13ba-f999-4b8d-b640-92f1cf25ea57 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:03.039035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 553/1117] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:46:02 2022] GET /identity/v3/role_assignments?user.id=47d38615155540459e34fab5882e170b&scope.project.id=389460c8ae004cc5a088fd96df37f941&role.id=8835b245e6e44fbb929afd739098a927 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:05.005673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919e259-fa2c-4953-a765-dd7284eca160 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:05.006266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919e259-fa2c-4953-a765-dd7284eca160 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:05.006266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8919e259-fa2c-4953-a765-dd7284eca160 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:05.007638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 565/1118] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:05.014473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:05.015185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:05.015325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:05.042681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:05.043848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:05.046807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:05.119576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 554/1119] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:05.142938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919e259-fa2c-4953-a765-dd7284eca160 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:05.187726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:05.254622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8919e259-fa2c-4953-a765-dd7284eca160 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:05.290131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:05.290979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:05.291262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:05.291534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] PATH_INFO: `/v3/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:05.293125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] RBAC: Authorizing `identity:get_role(role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:05.294521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:05.295884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 566/1120] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:05 2022] GET /identity/v3/roles/8835b245e6e44fbb929afd739098a927 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:05.302529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:05.408778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1eecb-3b89-41b3-8c37-fb256fc178cd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:05.444414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:05.445266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:05.445548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:05.445819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] PATH_INFO: `/v3/users/47d38615155540459e34fab5882e170b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:05.447120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] RBAC: Authorizing `identity:get_user(user_id=47d38615155540459e34fab5882e170b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:05.448570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:05.450962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 555/1121] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:05 2022] GET /identity/v3/users/47d38615155540459e34fab5882e170b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:05.458646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:05.565080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9def96-92c5-4795-998a-074cd9343a1d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:05.572801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:05.604234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b27284-17e4-4f64-8bf6-41b77048e99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:05.605079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b27284-17e4-4f64-8bf6-41b77048e99d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:05.605357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b27284-17e4-4f64-8bf6-41b77048e99d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:05.605622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b27284-17e4-4f64-8bf6-41b77048e99d None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:05.606924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b27284-17e4-4f64-8bf6-41b77048e99d None admin] RBAC: Authorizing `identity:get_project(project_id=389460c8ae004cc5a088fd96df37f941)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:05.608335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b27284-17e4-4f64-8bf6-41b77048e99d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:05.610002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 567/1122] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:05 2022] GET /identity/v3/projects/389460c8ae004cc5a088fd96df37f941 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:05.616628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:05.634002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:05.742139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15526b0a-5045-4e63-a374-b431f1d3191b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:05.780195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b214a5-7de5-41de-884f-834d44a12ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:05.781064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b214a5-7de5-41de-884f-834d44a12ccb None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:05.781341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b214a5-7de5-41de-884f-834d44a12ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:05.781610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b214a5-7de5-41de-884f-834d44a12ccb None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941/users/47d38615155540459e34fab5882e170b/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:05.784223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b214a5-7de5-41de-884f-834d44a12ccb None admin] RBAC: Authorizing `identity:create_grant(project_id=389460c8ae004cc5a088fd96df37f941, user_id=47d38615155540459e34fab5882e170b, role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:05.785631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b214a5-7de5-41de-884f-834d44a12ccb None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:05.804087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 556/1123] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:46:05 2022] PUT /identity/v3/projects/389460c8ae004cc5a088fd96df37f941/users/47d38615155540459e34fab5882e170b/roles/8835b245e6e44fbb929afd739098a927 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:46:07.795434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fea18-9a7b-4e1b-91b0-fabe7926dc55 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:07.796350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fea18-9a7b-4e1b-91b0-fabe7926dc55 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:07.796350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fea18-9a7b-4e1b-91b0-fabe7926dc55 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:07.798528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 568/1124] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:07.804095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:07.804541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:07.804638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:07.823318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:07.824501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:07.891757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:07.898637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 557/1125] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 13 09:46:07.928605 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fea18-9a7b-4e1b-91b0-fabe7926dc55 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:08.046630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fea18-9a7b-4e1b-91b0-fabe7926dc55 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:08.084562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:08.085765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:08.086117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:08.086487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] PATH_INFO: `/v3/roles/8835b245e6e44fbb929afd739098a927` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:08.088417 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] RBAC: Authorizing `identity:get_role(role_id=8835b245e6e44fbb929afd739098a927)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:08.089798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:08.091232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 569/1126] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:07 2022] GET /identity/v3/roles/8835b245e6e44fbb929afd739098a927 => generated 223 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:08.100161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:08.205457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b2689-8ea4-46a8-bddf-65ee71df9ac4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:08.241060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:08.241925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:08.242203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:08.242568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] PATH_INFO: `/v3/users/47d38615155540459e34fab5882e170b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:08.243861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] RBAC: Authorizing `identity:get_user(user_id=47d38615155540459e34fab5882e170b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:08.245289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:08.246949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 558/1127] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:08 2022] GET /identity/v3/users/47d38615155540459e34fab5882e170b => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:08.255508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:08.309179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:08.378718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a831deb0-0f04-4652-b2d6-edc2594df6aa None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:08.415331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:08.415969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:08.416272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:08.416549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:08.486444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:08.487923 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:08.530393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:08.594916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 570/1128] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 13 09:46:08.603853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:08.675262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:08.713751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a166b4-bb4e-4fe1-a0c9-961e23cf69f3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:08.751441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d563fe-ac4a-4acf-8a07-b4055572d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:08.752282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d563fe-ac4a-4acf-8a07-b4055572d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:08.752557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d563fe-ac4a-4acf-8a07-b4055572d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:08.752818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d563fe-ac4a-4acf-8a07-b4055572d8b9 None admin] PATH_INFO: `/v3/projects/389460c8ae004cc5a088fd96df37f941` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:08.754095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d563fe-ac4a-4acf-8a07-b4055572d8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=389460c8ae004cc5a088fd96df37f941)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:08.755627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d563fe-ac4a-4acf-8a07-b4055572d8b9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:08.757304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 559/1129] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:08 2022] GET /identity/v3/projects/389460c8ae004cc5a088fd96df37f941 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:08.766988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:08.880283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58805394-03e2-4ce7-9c7d-6ea8e2ef8535 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:08.915982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:08.916622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:08.916904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:08.917178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:08.917997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] RBAC: Adding query filter params (role.id=8835b245e6e44fbb929afd739098a927, scope.project.id=389460c8ae004cc5a088fd96df37f941, user.id=47d38615155540459e34fab5882e170b) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:08.918309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:08.919785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b02f0-1a6b-411c-99a9-f94d217d52a2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:08.925805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 571/1130] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:46:08 2022] GET /identity/v3/role_assignments?user.id=47d38615155540459e34fab5882e170b&scope.project.id=389460c8ae004cc5a088fd96df37f941&role.id=8835b245e6e44fbb929afd739098a927 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:10.957588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645b9c-018c-4660-9a4d-b417a5e4252a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:10.958501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645b9c-018c-4660-9a4d-b417a5e4252a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:10.958501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41645b9c-018c-4660-9a4d-b417a5e4252a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:10.960610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 560/1131] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:10.969483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:10.969909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:10.970046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:10.985455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:10.991042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:10.992232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:11.063119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 572/1132] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:11.086376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645b9c-018c-4660-9a4d-b417a5e4252a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:11.199270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41645b9c-018c-4660-9a4d-b417a5e4252a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:11.236106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ae807-e240-40ed-b1f6-72e887748c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:11.236817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae807-e240-40ed-b1f6-72e887748c0b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:11.237098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae807-e240-40ed-b1f6-72e887748c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:11.237373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ae807-e240-40ed-b1f6-72e887748c0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:11.238615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ae807-e240-40ed-b1f6-72e887748c0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:11.240142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ae807-e240-40ed-b1f6-72e887748c0b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:11.241866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 561/1133] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:46:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:11.248936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:11.354175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8384f758-2fe9-4e25-aad8-0fc36f6ddeaa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:11.394716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25769c61-e509-44d0-9837-2d6a2a5bf149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:11.395375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769c61-e509-44d0-9837-2d6a2a5bf149 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:11.395661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769c61-e509-44d0-9837-2d6a2a5bf149 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:11.395936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25769c61-e509-44d0-9837-2d6a2a5bf149 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:11.396649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769c61-e509-44d0-9837-2d6a2a5bf149 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:11.398093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25769c61-e509-44d0-9837-2d6a2a5bf149 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:11.402626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:11.428016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 573/1134] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:46:11 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:46:13.484848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d63b-76b9-4dd0-8458-299d87793f29 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:13.485721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d63b-76b9-4dd0-8458-299d87793f29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:13.485721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5d63b-76b9-4dd0-8458-299d87793f29 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:13.487947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 562/1135] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:13.494278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:13.494739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:13.494886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:13.522400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:13.524248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:13.598079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 574/1136] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:13.622992 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d63b-76b9-4dd0-8458-299d87793f29 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:13.626452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:13.740695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5d63b-76b9-4dd0-8458-299d87793f29 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:13.782286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e5d324-e8f2-4680-90a1-729ed96940ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:13.783092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d324-e8f2-4680-90a1-729ed96940ae None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:13.783377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d324-e8f2-4680-90a1-729ed96940ae None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:13.783648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e5d324-e8f2-4680-90a1-729ed96940ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:13.785031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5d324-e8f2-4680-90a1-729ed96940ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:13.786452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e5d324-e8f2-4680-90a1-729ed96940ae None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:13.788108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 563/1137] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:46:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:13.794749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:13.898767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426a38b6-70c8-4d2c-b7eb-337a60b7bc58 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:13.917149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:13.938264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0525f-c77d-431b-859c-e525683bfaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:13.938956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0525f-c77d-431b-859c-e525683bfaa0 None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:13.939240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0525f-c77d-431b-859c-e525683bfaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:13.939516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0525f-c77d-431b-859c-e525683bfaa0 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:13.940217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0525f-c77d-431b-859c-e525683bfaa0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:13.941653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0525f-c77d-431b-859c-e525683bfaa0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:13.964314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 575/1138] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:46:13 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:46:16.003093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775918-a3b2-452b-965e-150e93350366 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:16.003991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775918-a3b2-452b-965e-150e93350366 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:16.003991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a775918-a3b2-452b-965e-150e93350366 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:16.006154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 564/1139] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:16.012885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:16.013341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:16.013459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:16.034672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:16.035897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:16.106675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 576/1140] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:16.141742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775918-a3b2-452b-965e-150e93350366 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:16.218915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:16.252362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a775918-a3b2-452b-965e-150e93350366 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:16.287964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:16.288712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:16.288994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:16.289272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:16.301322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:46:16.308979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:16.310122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:16.311258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:46:16.314576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 565/1141] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:46:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:16.316823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:16.435756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac1101-1bef-4a02-b2eb-821c871a612f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:16.438128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:16.472579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:16.473245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:16.473525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:16.473799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:16.474586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:16.474894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:16.476266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:16.484637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 577/1142] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:46:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:46:16.490766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:16.614159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817885e8-4ffc-452a-ae66-6c68ac228060 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:16.650947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:16.659710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:16.661023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:16.661443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:16.661858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] PATH_INFO: `/v3/users/695a0fa8fc1945a59f0b0fce13f9861b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:16.678731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] RBAC: Authorizing `identity:get_user(user_id=695a0fa8fc1945a59f0b0fce13f9861b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:16.681116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:16.683660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 566/1143] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:16 2022] GET /identity/v3/users/695a0fa8fc1945a59f0b0fce13f9861b => generated 286 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:16.691444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:16.804915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791c4d76-d47b-4989-9e42-1bb51e913d80 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:16.839499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:16.840126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:16.840404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:16.840672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:16.874831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:16.914079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:16.916127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:17.025894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 578/1144] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:46:17.032146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:17.142271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601da98-2b3a-464f-9b04-74ec09b4aa48 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:17.182454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e72eb3-e689-48b5-bcfb-b0db1f49570e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:17.183321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72eb3-e689-48b5-bcfb-b0db1f49570e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:17.183600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72eb3-e689-48b5-bcfb-b0db1f49570e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:17.183875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e72eb3-e689-48b5-bcfb-b0db1f49570e None admin] PATH_INFO: `/v3/projects/caa1caa36a6a4120857813ce993a1962` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:17.185085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e72eb3-e689-48b5-bcfb-b0db1f49570e None admin] RBAC: Authorizing `identity:get_project(project_id=caa1caa36a6a4120857813ce993a1962)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:17.186526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e72eb3-e689-48b5-bcfb-b0db1f49570e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:17.188199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 567/1145] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:17 2022] GET /identity/v3/projects/caa1caa36a6a4120857813ce993a1962 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:46:17.197522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:17.282823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:17.327364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9a73e-ff43-4c37-9a8d-dfdd00a417d0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:17.363167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:17.363818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:17.364100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:17.364376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:17.365206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=caa1caa36a6a4120857813ce993a1962, user.id=695a0fa8fc1945a59f0b0fce13f9861b) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:17.365518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:17.367020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5ace3-9cbb-494a-8867-8a046b4e0432 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:17.374100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 579/1146] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:46:17 2022] GET /identity/v3/role_assignments?user.id=695a0fa8fc1945a59f0b0fce13f9861b&scope.project.id=caa1caa36a6a4120857813ce993a1962&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:19.336321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e288c-825a-4ff4-8158-cbacfe7bf94f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:19.336929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e288c-825a-4ff4-8158-cbacfe7bf94f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:19.336929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e288c-825a-4ff4-8158-cbacfe7bf94f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:19.338302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 568/1147] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:19.344828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:19.345541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:19.345699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:19.367076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:19.368310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:19.440039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 580/1148] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:19.471542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e288c-825a-4ff4-8158-cbacfe7bf94f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:19.535617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:19.584329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e288c-825a-4ff4-8158-cbacfe7bf94f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:19.623893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:19.624621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:19.624902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:19.625176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:19.636818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:46:19.644687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:19.645752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:46:19.646717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 569/1149] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:46:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:19.652840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:19.714708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:19.770044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb9c1e-f659-4ec8-9bf8-1af9b16d30bd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:19.805885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:19.806573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:19.806853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:19.807122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:19.807866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:19.808170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:19.809541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:19.818029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 581/1150] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:46:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:19.825333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:19.925418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a8017-1f23-45d1-8ec2-07f5fcf3ac69 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:19.943372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:19.962881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:19.963737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:19.964014 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:19.964281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] PATH_INFO: `/v3/users/695a0fa8fc1945a59f0b0fce13f9861b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:19.965575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] RBAC: Authorizing `identity:get_user(user_id=695a0fa8fc1945a59f0b0fce13f9861b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:19.967028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:19.968648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 570/1151] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:19 2022] GET /identity/v3/users/695a0fa8fc1945a59f0b0fce13f9861b => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:19.977805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:20.087271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f65c2-09f8-407d-9bf7-ce19afa239ad None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:20.111499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:20.124203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3d4fa-5747-471a-96f0-6e0ea8f21604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:20.125052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d4fa-5747-471a-96f0-6e0ea8f21604 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:20.125330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d4fa-5747-471a-96f0-6e0ea8f21604 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:20.125606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3d4fa-5747-471a-96f0-6e0ea8f21604 None admin] PATH_INFO: `/v3/projects/caa1caa36a6a4120857813ce993a1962` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:20.126828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d4fa-5747-471a-96f0-6e0ea8f21604 None admin] RBAC: Authorizing `identity:get_project(project_id=caa1caa36a6a4120857813ce993a1962)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:20.128268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3d4fa-5747-471a-96f0-6e0ea8f21604 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:20.129959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 582/1152] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:19 2022] GET /identity/v3/projects/caa1caa36a6a4120857813ce993a1962 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:20.137868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:20.243737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42304929-ab82-419d-b0bd-fa1dfa68c4d0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:20.289095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2d49c-fb6b-446b-a79b-287de0164db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:20.289971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2d49c-fb6b-446b-a79b-287de0164db0 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:20.290226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2d49c-fb6b-446b-a79b-287de0164db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:20.290558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2d49c-fb6b-446b-a79b-287de0164db0 None admin] PATH_INFO: `/v3/projects/caa1caa36a6a4120857813ce993a1962/users/695a0fa8fc1945a59f0b0fce13f9861b/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:20.292625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2d49c-fb6b-446b-a79b-287de0164db0 None admin] RBAC: Authorizing `identity:create_grant(project_id=caa1caa36a6a4120857813ce993a1962, user_id=695a0fa8fc1945a59f0b0fce13f9861b, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:20.294044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2d49c-fb6b-446b-a79b-287de0164db0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:20.310600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 571/1153] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:46:20 2022] PUT /identity/v3/projects/caa1caa36a6a4120857813ce993a1962/users/695a0fa8fc1945a59f0b0fce13f9861b/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:46:22.288604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f6827-2741-4cb6-8eec-4b8328399237 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:22.289191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f6827-2741-4cb6-8eec-4b8328399237 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:22.289191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f6827-2741-4cb6-8eec-4b8328399237 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:22.290878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 583/1154] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:22.297206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:22.297939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:22.298090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:22.316278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:22.317462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:22.361405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:22.392405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 572/1155] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:22.416747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f6827-2741-4cb6-8eec-4b8328399237 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:22.533506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f6827-2741-4cb6-8eec-4b8328399237 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:22.569228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:22.569941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:22.570224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:22.570529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:22.581556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:46:22.589646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:22.590780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:46:22.592340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 584/1156] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:46:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:22.600901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:22.710954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969ddff-f4e9-48f3-83c5-06310acdd6b8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:22.746726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:22.747451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:22.747738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:22.748019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:22.748774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:22.749084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:22.750463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:22.759192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 573/1157] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:46:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:22.765950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:22.819955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:22.884688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65269986-28b4-49ae-8ccd-0d9dc5673866 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:22.920494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:22.921367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:22.921645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:22.921913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] PATH_INFO: `/v3/users/695a0fa8fc1945a59f0b0fce13f9861b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:22.923256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] RBAC: Authorizing `identity:get_user(user_id=695a0fa8fc1945a59f0b0fce13f9861b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:22.924717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:22.926380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 585/1158] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:22 2022] GET /identity/v3/users/695a0fa8fc1945a59f0b0fce13f9861b => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:22.933617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:22.982437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:23.052629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a6644-3cf6-4d76-813c-1a475651b309 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:23.088195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:23.088766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:23.089060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:23.089286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:23.162684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:23.164114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:23.203337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:23.285728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 574/1159] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:46:23.292897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:23.406126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01bcaf-3edf-452d-9280-239d3bc5ebb8 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:23.423729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:23.443580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb548b2-86e5-40b2-912b-a8a06783d9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:23.444438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb548b2-86e5-40b2-912b-a8a06783d9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:23.444718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb548b2-86e5-40b2-912b-a8a06783d9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:23.444991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb548b2-86e5-40b2-912b-a8a06783d9c9 None admin] PATH_INFO: `/v3/projects/caa1caa36a6a4120857813ce993a1962` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:23.446241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb548b2-86e5-40b2-912b-a8a06783d9c9 None admin] RBAC: Authorizing `identity:get_project(project_id=caa1caa36a6a4120857813ce993a1962)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:23.447914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb548b2-86e5-40b2-912b-a8a06783d9c9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:23.449618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 586/1160] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:23 2022] GET /identity/v3/projects/caa1caa36a6a4120857813ce993a1962 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:23.459451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:23.567168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f30633-e554-42a2-8eec-ddc449b1a0fc None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:23.608432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:23.609086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:23.609371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:23.609645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:23.610481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=caa1caa36a6a4120857813ce993a1962, user.id=695a0fa8fc1945a59f0b0fce13f9861b) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:23.610817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:23.612272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f8640-88e3-4510-93eb-b807b5b1d42e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:23.615322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:23.619082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 575/1161] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:46:23 2022] GET /identity/v3/role_assignments?user.id=695a0fa8fc1945a59f0b0fce13f9861b&scope.project.id=caa1caa36a6a4120857813ce993a1962&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:25.642024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60651a24-b937-4f12-8b04-8c6e604d310b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:25.642627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60651a24-b937-4f12-8b04-8c6e604d310b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:25.642627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60651a24-b937-4f12-8b04-8c6e604d310b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:25.643924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 587/1162] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:25.650722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:25.651548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:25.651784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:25.679642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:25.681277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:25.757837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 576/1163] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:25.781090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60651a24-b937-4f12-8b04-8c6e604d310b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:25.889275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60651a24-b937-4f12-8b04-8c6e604d310b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:25.925098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:25.925675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:25.925954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:25.926231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:25.982242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:25.997371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:25.998898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:26.109632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 588/1164] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:46:26.116652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:26.226502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229c208-4872-410b-bf8a-5136ff114e36 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:26.256041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:26.263103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:26.263890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:26.264166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:26.264412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:26.271850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:26.273276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-92bbebab-3757-497f-a47d-5e99d345093a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:26.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:26.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:46:26.290446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 577/1165] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:46:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:26.297784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:26.413739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:26.430161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8567f711-f992-4e7d-8d79-995ed1e64921 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:26.469542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:26.470209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:26.470521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:26.470798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:26.471526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:26.471838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:26.473214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b6555-bc75-4cb6-a2bf-e0bd3d576bec None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:26.480810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 589/1166] 10.222.0.17 () {56 vars in 1115 bytes} [Wed Jul 13 09:46:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:28.459964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbcf2-cddf-4c92-a54f-fb87fed4baa0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:28.460855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbcf2-cddf-4c92-a54f-fb87fed4baa0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:28.460855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dbcf2-cddf-4c92-a54f-fb87fed4baa0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:28.463139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 578/1167] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:28.468744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f0b-dec9-4a05-b852-e0ca253e0734 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:28.469189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f0b-dec9-4a05-b852-e0ca253e0734 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:28.469287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb0f0b-dec9-4a05-b852-e0ca253e0734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:28.488450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9dfb0f0b-dec9-4a05-b852-e0ca253e0734 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:28.489629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9dfb0f0b-dec9-4a05-b852-e0ca253e0734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:28.561452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 590/1168] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:28.594451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbcf2-cddf-4c92-a54f-fb87fed4baa0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:28.707365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dbcf2-cddf-4c92-a54f-fb87fed4baa0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:28.746170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6129185-742e-4971-83bd-2df72e22d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:28.746855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129185-742e-4971-83bd-2df72e22d01b None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:28.747128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129185-742e-4971-83bd-2df72e22d01b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:28.747401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129185-742e-4971-83bd-2df72e22d01b None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:28.748125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129185-742e-4971-83bd-2df72e22d01b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:28.749483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129185-742e-4971-83bd-2df72e22d01b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:28.773539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 579/1169] 10.222.0.17 () {60 vars in 1138 bytes} [Wed Jul 13 09:46:28 2022] POST /identity/v3/domains => generated 267 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:46:30.810464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3108c-26ed-4a03-98b7-b92dd3fd5f52 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:30.811020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3108c-26ed-4a03-98b7-b92dd3fd5f52 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:30.811020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3108c-26ed-4a03-98b7-b92dd3fd5f52 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:30.813147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 591/1170] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:30.821815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:30.822217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:30.822409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:30.845438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:30.846671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:30.897179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:30.920685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 580/1171] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:30.948717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3108c-26ed-4a03-98b7-b92dd3fd5f52 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:31.041503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:31.065491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3108c-26ed-4a03-98b7-b92dd3fd5f52 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:31.106037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9422dc8-3a03-43a0-a0be-361b46b7eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:31.106929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9422dc8-3a03-43a0-a0be-361b46b7eb6a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:31.107203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9422dc8-3a03-43a0-a0be-361b46b7eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:31.107471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9422dc8-3a03-43a0-a0be-361b46b7eb6a None admin] PATH_INFO: `/v3/domains/24a669b43dea4b41860fc7abbe6ec364` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:31.118577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9422dc8-3a03-43a0-a0be-361b46b7eb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=24a669b43dea4b41860fc7abbe6ec364)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:31.120040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9422dc8-3a03-43a0-a0be-361b46b7eb6a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:31.121670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 592/1172] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jul 13 09:46:30 2022] GET /identity/v3/domains/24a669b43dea4b41860fc7abbe6ec364 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:31.128052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:31.246691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a64f21-d954-4a3f-805d-87d00293bdf9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:31.283576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e95d7-1848-4494-9416-537759943150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:31.284222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e95d7-1848-4494-9416-537759943150 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:31.284493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e95d7-1848-4494-9416-537759943150 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:31.284761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e95d7-1848-4494-9416-537759943150 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:31.285454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e95d7-1848-4494-9416-537759943150 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:31.286898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e95d7-1848-4494-9416-537759943150 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:31.322260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 581/1173] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:46:31 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:46:33.374527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce52dc6-085e-4274-af18-3f2324610d02 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:33.374983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce52dc6-085e-4274-af18-3f2324610d02 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:33.375086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce52dc6-085e-4274-af18-3f2324610d02 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:33.376466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 593/1174] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:33.382818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:33.383553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:33.383553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:33.402156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:33.403515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:33.430972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:33.480100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 582/1175] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:33.505220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce52dc6-085e-4274-af18-3f2324610d02 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:33.615855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce52dc6-085e-4274-af18-3f2324610d02 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:33.650829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036c39ec-132f-44ec-8e11-e6a4ab686be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:33.651616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c39ec-132f-44ec-8e11-e6a4ab686be9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:33.651889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c39ec-132f-44ec-8e11-e6a4ab686be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:33.652154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c39ec-132f-44ec-8e11-e6a4ab686be9 None admin] PATH_INFO: `/v3/domains/24a669b43dea4b41860fc7abbe6ec364` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:33.653333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c39ec-132f-44ec-8e11-e6a4ab686be9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=24a669b43dea4b41860fc7abbe6ec364)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:33.654800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036c39ec-132f-44ec-8e11-e6a4ab686be9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:33.656461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 594/1176] 10.222.0.17 () {56 vars in 1183 bytes} [Wed Jul 13 09:46:33 2022] GET /identity/v3/domains/24a669b43dea4b41860fc7abbe6ec364 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:33.663182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:33.773194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55bca0-0b81-4e84-b028-c062bb0738d8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:33.808574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e9d88-5459-4b98-86a0-60c13c8302a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:33.809222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e9d88-5459-4b98-86a0-60c13c8302a3 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:33.809504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e9d88-5459-4b98-86a0-60c13c8302a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:33.809778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e9d88-5459-4b98-86a0-60c13c8302a3 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:33.810584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e9d88-5459-4b98-86a0-60c13c8302a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:33.812007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e9d88-5459-4b98-86a0-60c13c8302a3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:33.834771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 583/1177] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:46:33 2022] POST /identity/v3/users => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:46:35.858116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c18e-c2dd-4411-b9ac-285d7aec071c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:35.859036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c18e-c2dd-4411-b9ac-285d7aec071c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:35.859036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a1c18e-c2dd-4411-b9ac-285d7aec071c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:35.861352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 595/1178] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:35.870461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:35.871217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:35.871379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:35.894381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:35.895644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:35.910252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:35.974656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 584/1179] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:35.999103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c18e-c2dd-4411-b9ac-285d7aec071c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:36.016949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:36.113069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a1c18e-c2dd-4411-b9ac-285d7aec071c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:36.149409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:36.150196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:36.150513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:36.150780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:36.161344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:46:36.169669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:36.170800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:46:36.171797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 596/1180] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:46:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:36.179374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:36.284118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533b611-18d4-4e19-b9dd-59f898927d29 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:36.319448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:36.320101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:36.320382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:36.320722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:36.321557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:36.321861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:36.323225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:36.332338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 585/1181] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:46:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:36.340807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:36.418645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:36.467438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b13ecce-e310-432b-bd2a-57aa909860a5 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:36.503698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:36.504564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:36.504847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:36.505116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] PATH_INFO: `/v3/users/6432173ec596415da3defa5d18eb1860` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:36.519506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] RBAC: Authorizing `identity:get_user(user_id=6432173ec596415da3defa5d18eb1860)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:36.520946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:36.522625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 597/1182] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:36 2022] GET /identity/v3/users/6432173ec596415da3defa5d18eb1860 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:46:36.529629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:36.546347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:36.639392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f91579-b37f-4733-afbe-bc5c77eccd30 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:36.674556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:36.675188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:36.675463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:36.675736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:36.743466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:36.744885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:36.755873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:36.845551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 586/1183] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:46:36.855362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:36.971277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3f65c-49d6-4c58-aa3a-cd47067be648 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:36.997282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:37.012625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d33b737-ac4e-4c45-97e4-fb55482b193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:37.013960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b737-ac4e-4c45-97e4-fb55482b193b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:37.014324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b737-ac4e-4c45-97e4-fb55482b193b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:37.014733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d33b737-ac4e-4c45-97e4-fb55482b193b None admin] PATH_INFO: `/v3/projects/c1afdc6989e74868922053b15926016a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:37.016753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b737-ac4e-4c45-97e4-fb55482b193b None admin] RBAC: Authorizing `identity:get_project(project_id=c1afdc6989e74868922053b15926016a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:37.019108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d33b737-ac4e-4c45-97e4-fb55482b193b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:37.021789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 598/1184] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:36 2022] GET /identity/v3/projects/c1afdc6989e74868922053b15926016a => generated 361 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:37.028907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:37.133503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2da58-2885-495d-90a6-9e8895f906c9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:37.144487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:37.176097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:37.176745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:37.177033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:37.177313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:37.178139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=c1afdc6989e74868922053b15926016a, user.id=6432173ec596415da3defa5d18eb1860) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:37.178464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:37.179919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27409f-e098-4299-8d9f-577fb15a890c None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:37.185472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 587/1185] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:46:37 2022] GET /identity/v3/role_assignments?user.id=6432173ec596415da3defa5d18eb1860&scope.project.id=c1afdc6989e74868922053b15926016a&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:46:39.205683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bfaac-316c-4ffc-ae0b-76d6da2c9182 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:39.206559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bfaac-316c-4ffc-ae0b-76d6da2c9182 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:39.206683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013bfaac-316c-4ffc-ae0b-76d6da2c9182 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:39.208873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 599/1186] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:39.214439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:39.214879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:39.214979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:39.233388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:39.234617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:39.311261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 588/1187] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:39.338402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bfaac-316c-4ffc-ae0b-76d6da2c9182 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:39.453339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013bfaac-316c-4ffc-ae0b-76d6da2c9182 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:39.488582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:39.489297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:39.489576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:39.489848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:39.500077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:46:39.507529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:39.510334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:46:39.511403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 600/1188] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:46:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:39.515377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:39.618494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2183-77b2-4d9a-a87f-f97335ac7118 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:39.620828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:39.659327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:39.659976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:39.660251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:39.660523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:39.661262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:39.661564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:39.662955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:39.671518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 589/1189] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:46:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:39.677531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:39.738995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:39.787794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504fc72-2030-4f5a-bc54-2de35560a6bd None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:39.824984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:39.825854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:39.826136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:39.826411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] PATH_INFO: `/v3/users/6432173ec596415da3defa5d18eb1860` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:39.827747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] RBAC: Authorizing `identity:get_user(user_id=6432173ec596415da3defa5d18eb1860)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:39.829182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:39.830855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 601/1190] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:39 2022] GET /identity/v3/users/6432173ec596415da3defa5d18eb1860 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:39.837573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:39.955046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829105d9-abd2-4a07-ac5c-babaf2f4b9d3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:39.989395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7873b20a-d987-4f54-a60b-2ea44568254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:39.990169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873b20a-d987-4f54-a60b-2ea44568254f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:39.990458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873b20a-d987-4f54-a60b-2ea44568254f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:39.990736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7873b20a-d987-4f54-a60b-2ea44568254f None admin] PATH_INFO: `/v3/projects/c1afdc6989e74868922053b15926016a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:39.991948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873b20a-d987-4f54-a60b-2ea44568254f None admin] RBAC: Authorizing `identity:get_project(project_id=c1afdc6989e74868922053b15926016a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:39.993436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7873b20a-d987-4f54-a60b-2ea44568254f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:39.995136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 590/1191] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:39 2022] GET /identity/v3/projects/c1afdc6989e74868922053b15926016a => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:40.004430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:40.130204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238b1e8c-0ef0-4656-a755-752ba2c9e39d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:40.154140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:40.170076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfdb222-1ceb-44f3-ae23-2f957f68f0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:40.170998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdb222-1ceb-44f3-ae23-2f957f68f0bb None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:40.171280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdb222-1ceb-44f3-ae23-2f957f68f0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:40.171554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfdb222-1ceb-44f3-ae23-2f957f68f0bb None admin] PATH_INFO: `/v3/projects/c1afdc6989e74868922053b15926016a/users/6432173ec596415da3defa5d18eb1860/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:40.173682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdb222-1ceb-44f3-ae23-2f957f68f0bb None admin] RBAC: Authorizing `identity:create_grant(project_id=c1afdc6989e74868922053b15926016a, user_id=6432173ec596415da3defa5d18eb1860, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:40.175204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfdb222-1ceb-44f3-ae23-2f957f68f0bb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:40.191031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 602/1192] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:46:40 2022] PUT /identity/v3/projects/c1afdc6989e74868922053b15926016a/users/6432173ec596415da3defa5d18eb1860/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:46:42.173807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a1e0-1772-4e70-9b53-bc331c54a516 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:42.174738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a1e0-1772-4e70-9b53-bc331c54a516 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:42.174738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a1e0-1772-4e70-9b53-bc331c54a516 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:42.176993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 591/1193] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:46:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:46:42.182477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:42.182915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:42.183034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:42.201165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:46:42.202356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:46:42.270991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 603/1194] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:46:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:46:42.294688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a1e0-1772-4e70-9b53-bc331c54a516 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:42.350317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:42.418652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a1e0-1772-4e70-9b53-bc331c54a516 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:42.464259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:42.465047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:42.465325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:42.465597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:42.476927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:46:42.484368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:46:42.485546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:46:42.486652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 592/1195] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:46:42.491787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:42.599508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb95ac5-10fd-4658-a135-2aec5c203b4e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:42.612834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:42.636986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:42.637947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:42.638224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:42.638632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:42.639381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:42.639680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:42.641035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:42.649448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 604/1196] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:42.656009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:42.763273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:42.771855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4bcd7-4ebe-4da2-8dab-3b0b30c9990c None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:42.812119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:42.812977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:42.813251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:42.813517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] PATH_INFO: `/v3/users/6432173ec596415da3defa5d18eb1860` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:42.814849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=6432173ec596415da3defa5d18eb1860)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:42.816268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:42.817879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 593/1197] 10.222.0.17 () {56 vars in 1177 bytes} [Wed Jul 13 09:46:42 2022] GET /identity/v3/users/6432173ec596415da3defa5d18eb1860 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:42.826760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:42.935709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593c244-505c-4847-8a19-cdb3b98bd1ff None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:42.972396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:42.973060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:42.973340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:42.973610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:43.016472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:43.043901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:43.045341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:43.148066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 605/1198] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:46:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:46:43.154806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:43.269299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2403d-4b2f-4562-9b6a-82cc52250bd2 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:43.305012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86424603-6cba-4b28-ada4-e796e4cd6c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:43.305622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424603-6cba-4b28-ada4-e796e4cd6c6a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:43.305897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424603-6cba-4b28-ada4-e796e4cd6c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:43.306167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86424603-6cba-4b28-ada4-e796e4cd6c6a None admin] PATH_INFO: `/v3/projects/c1afdc6989e74868922053b15926016a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:43.307463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86424603-6cba-4b28-ada4-e796e4cd6c6a None admin] RBAC: Authorizing `identity:get_project(project_id=c1afdc6989e74868922053b15926016a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:43.308909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86424603-6cba-4b28-ada4-e796e4cd6c6a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:43.310619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 594/1199] 10.222.0.17 () {56 vars in 1186 bytes} [Wed Jul 13 09:46:43 2022] GET /identity/v3/projects/c1afdc6989e74868922053b15926016a => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:43.316959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:46:43.395367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:43.431672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314921b5-e153-4782-a54a-53a08b47dfed None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:46:43.474900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:46:43.475539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:46:43.475812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:46:43.476083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:46:43.477109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=c1afdc6989e74868922053b15926016a, user.id=6432173ec596415da3defa5d18eb1860) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:46:43.477536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:46:43.479075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daf77d-e2a7-47e5-aeff-a737eb66ceb7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:46:43.485093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 606/1200] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:46:43 2022] GET /identity/v3/role_assignments?user.id=6432173ec596415da3defa5d18eb1860&scope.project.id=c1afdc6989e74868922053b15926016a&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:46:53.299621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=85 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:46:53.482477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=31 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:38.524254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a4a3-8f7a-47ac-816d-24f0571e1aab None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:38.525189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a4a3-8f7a-47ac-816d-24f0571e1aab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:38.525189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3667a4a3-8f7a-47ac-816d-24f0571e1aab None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:38.526515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 595/1201] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:47:38.532040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:38.532783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:38.532783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:38.553880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:47:38.556238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:47:38.661843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 607/1202] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:47:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:47:38.696890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a4a3-8f7a-47ac-816d-24f0571e1aab None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:38.854989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3667a4a3-8f7a-47ac-816d-24f0571e1aab None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:38.895747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:38.896746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:38.897000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:38.897225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:38.908934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:38.910407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:38.933852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:38.934938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:38.935919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:38.935919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:38.935919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:38.935919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:38.941148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 596/1203] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:38.942819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:39.107581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a5183-7ee2-45a9-85b6-fc6be1244a9d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:39.141182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:39.147230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:39.147921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:39.148200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:39.148514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:39.149223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:39.149532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:39.152124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d284565-ec2d-4aae-ab01-2ff75cb9937f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:39.173337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 608/1204] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:39.174999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:39.256812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:39.316134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ead30-1aef-4ffa-914d-64ff8371dbe0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:39.354753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd3c83-e7d2-4680-8318-9a528debc088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:39.355453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3c83-e7d2-4680-8318-9a528debc088 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:39.355738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3c83-e7d2-4680-8318-9a528debc088 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:39.356010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd3c83-e7d2-4680-8318-9a528debc088 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:39.356727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3c83-e7d2-4680-8318-9a528debc088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:39.358183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd3c83-e7d2-4680-8318-9a528debc088 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:39.387762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 597/1205] 10.222.0.17 () {60 vars in 1132 bytes} [Wed Jul 13 09:47:39 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:47:41.778797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96ab0-f43b-4994-b75c-72ad9f845059 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:41.779392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96ab0-f43b-4994-b75c-72ad9f845059 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:41.779392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df96ab0-f43b-4994-b75c-72ad9f845059 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:41.780738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 609/1206] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:47:41.787399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:41.787856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:41.787974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:41.808430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:47:41.809607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:47:41.898311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 598/1207] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:47:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:47:41.925719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96ab0-f43b-4994-b75c-72ad9f845059 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:42.040103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df96ab0-f43b-4994-b75c-72ad9f845059 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:42.081457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:42.082687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:42.083109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:42.083518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:42.104317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:47:42.114284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:42.116089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:42.117404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 610/1208] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:47:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:42.123158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:42.172047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:42.239349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7768335-7ab3-4dd1-81f9-c3d324fb912d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:42.286883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:42.287597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:42.288076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:42.288363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:42.289124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:42.289463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:42.291149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:42.305644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 599/1209] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:47:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:42.307300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:42.369876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:42.430701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adc61b-5110-44f4-b3c5-7bc56a1854a7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:42.486924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:42.487743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:42.488053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:42.488307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:42.499446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:42.503067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:42.524567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:42.525661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:42.533389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:42.533389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:42.533389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:42.533389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:42.533389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 611/1210] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:42.533748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:42.650483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:42.654024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b13f-4afd-45cd-9f5d-f6b9a7f65da8 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:42.694286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:42.695033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:42.695326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:42.695603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:42.696322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:42.696653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:42.698112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:42.711791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 600/1211] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:42.717864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:42.845254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7962fb7-368a-4cb0-b824-759909f1c431 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:42.847125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:42.887384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:42.888196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:42.888480 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:42.888753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:42.898602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:42.900087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:47:42.917182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:42.918230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:42.919379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 612/1212] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:42.926668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:43.068184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fa0b5-59ba-4c66-b0d2-ee78fb979f15 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:43.115675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:43.116725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:43.117546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:43.117941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:43.119232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:43.119792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:43.122607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:43.149697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 601/1213] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 09:47:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:43.155524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:43.273597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1d2147-717e-4ec8-8b81-4f3a79d930f6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:43.313545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:43.314190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:43.314515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:43.314764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:43.347306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:43.392113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:43.393591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:43.525986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 613/1214] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:47:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:47:43.527274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:43.553396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:43.655571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580eb520-bd58-4630-ac86-ac3d3d4306c0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:43.701891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:43.702943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:43.703411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:43.703767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:43.715481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:43.716930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:43.736647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:43.737646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:43.738586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:43.738586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:43.738586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:43.738586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:43.738586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 602/1215] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:43.744403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:43.840636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:43.908036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ff0b3-c100-47fd-bc35-61e87bee3e42 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:43.964629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:43.965385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:43.965747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:43.966029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:43.966994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:43.967434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:43.969265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:43.984418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 614/1216] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:47:43.990269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:44.070699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:44.120531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e4865-e7cb-481b-bec1-b71c3a2f325b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:44.163779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:44.165579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:44.166287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:44.166675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:44.176049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:44.178325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:47:44.194238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:44.195450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:44.202831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 603/1217] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:47:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:44.203501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:44.326627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21f2f2-7034-4fc8-87f4-7e574f4bc701 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:44.352507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:44.374672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:44.375456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:44.375802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:44.376134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:44.376989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:44.379554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:44.381133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a570d13-df75-4e58-a98b-7fbbed1d1306 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:44.395115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 615/1218] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:47:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:44.401763 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:44.525974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0867743-da40-4e27-b2f3-9961c021fe60 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:44.558822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:44.566445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:44.567190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:44.567496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:44.567759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:44.568899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=b89a3526406c42819414b773fe8663ff) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:44.569297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:44.570652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08534dc2-41fb-45e6-8c2f-d9852eba280f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:44.576948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 604/1219] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:47:44 2022] GET /identity/v3/role_assignments?user.id=b89a3526406c42819414b773fe8663ff&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:46.589253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc843-7271-4381-bc00-84b8ad52455f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:46.589867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc843-7271-4381-bc00-84b8ad52455f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:46.589867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fc843-7271-4381-bc00-84b8ad52455f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:46.591214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 616/1220] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:47:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:47:46.596496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:46.596903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:46.597093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:46.616813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:47:46.618158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:47:46.692370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 605/1221] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:47:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:47:46.714692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc843-7271-4381-bc00-84b8ad52455f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:46.820664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fc843-7271-4381-bc00-84b8ad52455f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:46.857523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:46.858319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:46.858625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:46.858903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:46.869734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:47:46.877504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:46.878660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:46.879549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 617/1222] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:47:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:46.885229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:47.005004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7067abdd-fda3-4006-9b09-3df4aab8dd2e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:47.032279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:47.045904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:47.046793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:47.047077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:47.047367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:47.048099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] RBAC: Adding query filter params (name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:47.048441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:47.050198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:47.058760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 606/1223] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:47:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:47.064667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:47.114871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:47.178443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fd5e9-50d4-4fd0-a335-60cd7d975565 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:47.220148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:47.220148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:47.220148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:47.220148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:47.232894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:47.234543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:47.253907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:47.255124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:47.256273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:47.256273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:47.256273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:47.256273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:47.256273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 618/1224] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:47.261952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:47.381510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3ff866-b2a4-4d5e-aa12-8c126e126cea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:47.419102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:47.419847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:47.420180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:47.420490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:47.421319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:47.421669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:47.423231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:47.438148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 607/1225] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:47.443987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:47.555472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:47.562979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c675ff0-dd6d-413f-b814-ce0ce91d57b9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:47.607542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:47.608356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:47.608634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:47.608959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:47.618604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:47.620552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:47:47.637359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:47.638398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:47.639787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 619/1226] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:47.644568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:47.699653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:47.765189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae09d6f-4515-4d72-9bfe-e294a86efb90 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:47.806129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:47.806937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:47.807253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:47.807505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:47.808640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:47.808917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:47.811027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:47.834020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 608/1227] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 09:47:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:47.841896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:47.960563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd01f2-98a0-4b87-a709-a2a576c5ddde None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:47.998794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:47.999668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:47.999951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:48.000256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:48.010983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:48.012743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:48.029959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:48.031148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:48.032548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:48.032548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:48.032548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:48.032548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:48.032548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 620/1228] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:48.038385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:48.150101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1bde8-2d4f-443f-9966-74202ac5c382 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:48.152409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:48.195613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:48.196554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:48.196911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:48.197288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:48.198260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:48.198676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:48.200570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:48.217382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 609/1229] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:48.223447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:48.233877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:48.334291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db93711-a9a5-4027-8ab4-a49509b39871 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:48.370054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:48.370868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:48.371140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:48.371408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:48.380411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:48.382015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:47:48.397049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:48.398038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:48.399000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 621/1230] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:47:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:48.404562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:48.525191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb70af-a4ba-4e9b-a105-e1974ce607ea None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:48.561372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:48.562037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:48.562329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:48.562657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:48.563410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:48.563735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:48.565136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf2e73-dafc-49b8-8ce4-223bed4fa18f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:48.582485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 610/1231] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:47:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:48.586217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:48.657132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:48.694224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33ff6-5bd0-48e3-ac80-9930930c28c9 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:48.729478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b9af9-da84-4d0a-98c3-05dd20b0a9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:48.730401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9af9-da84-4d0a-98c3-05dd20b0a9fb None admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:48.730709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9af9-da84-4d0a-98c3-05dd20b0a9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:48.730980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b9af9-da84-4d0a-98c3-05dd20b0a9fb None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/b89a3526406c42819414b773fe8663ff/roles/49b518fd6a304c5a9f7b431cea993279` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:48.747902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b9af9-da84-4d0a-98c3-05dd20b0a9fb None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=b89a3526406c42819414b773fe8663ff, role_id=49b518fd6a304c5a9f7b431cea993279)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:48.750068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b9af9-da84-4d0a-98c3-05dd20b0a9fb None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:48.772196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 622/1232] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:47:48 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/b89a3526406c42819414b773fe8663ff/roles/49b518fd6a304c5a9f7b431cea993279 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:47:50.896699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ffcb-f948-47dc-a75f-fccbfda5cd29 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:50.896699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ffcb-f948-47dc-a75f-fccbfda5cd29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:50.897349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54ffcb-f948-47dc-a75f-fccbfda5cd29 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:50.898306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 611/1233] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:47:50.903945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:50.904407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:50.904536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:50.923293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:47:50.924597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:47:51.002807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 623/1234] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:47:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:47:51.028184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ffcb-f948-47dc-a75f-fccbfda5cd29 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:51.054934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:51.145779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54ffcb-f948-47dc-a75f-fccbfda5cd29 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:51.184239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:51.184996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:51.185297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:51.185573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:51.198175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:47:51.205733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:51.206914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:51.207803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 612/1235] 10.222.0.17 () {56 vars in 1102 bytes} [Wed Jul 13 09:47:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:51.213796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:51.261805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:51.319522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcdcc67-e1cf-4b17-ba01-867916b0acf5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:51.357250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:51.357921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:51.358203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:51.358607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:51.359260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] RBAC: Adding query filter params (name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:51.359563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:51.360958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:51.370505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 624/1236] 10.222.0.17 () {56 vars in 1103 bytes} [Wed Jul 13 09:47:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:51.375695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:51.483263 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:51.499659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5074d41-e9dd-4a32-84e6-1db1691180e4 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:51.536847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:51.537775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:51.537907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:51.538160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:51.549850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:51.551337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:51.568562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:51.569695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:51.570785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:51.570785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:51.570785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:51.570785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:51.570785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 613/1237] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:51.576122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:51.688306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd05df-639f-4192-9e9e-0defc1e2a3df None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:51.701032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:51.735105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:51.735795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:51.736759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:51.737045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:51.737892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:51.738230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:51.740720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:51.764802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 625/1238] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:51.772413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:51.909032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e37a753-a289-421f-a471-58a5933b5aac None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:51.944232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:51.945030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:51.945308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:51.945578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:51.948552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:51.955156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:51.956643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:47:51.972328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:51.974686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:51.976855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 614/1239] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:51.982600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:52.093510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e044c8d-f346-4660-9267-dd11070c3b2a None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:52.136822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:52.137527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:52.137921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:52.138196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:52.139178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:52.139485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:52.140984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:52.167464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 626/1240] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 09:47:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:52.168621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:52.284509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cc1d4-c4d7-436b-b5f1-0c28d7b01e40 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:52.322084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:52.322824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:52.323099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:52.323440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:52.398039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:52.409949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:52.412168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:52.524576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 615/1241] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:47:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:47:52.530684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:52.559904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:52.639970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633587a-e5f4-437c-945b-a7eb72e180d0 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:52.675787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:52.676577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:52.676859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:52.677200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:52.688233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:52.689917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:52.708623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:52.709619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:52.710590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:52.710590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:52.710590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:52.710590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:52.710590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 627/1242] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:52.715505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:52.818822 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:52.825113 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaee2b-364c-4c2f-a7ab-4c5fe43780e1 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:52.859901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:52.860600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:52.860878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:52.861151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:52.861863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:52.862164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:52.863547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:52.876582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 616/1243] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:52.882778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:52.970035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:52.992951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8765c-4955-4657-a284-a97702bb6eab None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:53.031857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:53.032664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:53.032944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:53.033227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:53.040570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:53.042063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:47:53.056729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:53.057851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:53.058997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 628/1244] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:47:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:53.064700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:53.186626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f3193-fdcb-4234-8d31-149e8213422e None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:53.223353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:53.223610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:53.223708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:53.223988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:53.224821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:53.225118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:53.226560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f84d58-2da0-48ed-9ad4-6f70022e8456 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:53.238953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 617/1245] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:47:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:53.245946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:53.355545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ade5b-29fd-4995-954f-e0b581678532 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:53.399335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:53.399981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:53.400261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:53.400536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:53.401385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] RBAC: Adding query filter params (role.id=49b518fd6a304c5a9f7b431cea993279, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=b89a3526406c42819414b773fe8663ff) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:53.401678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:53.403145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac47075-1273-43e0-8b91-df191caddc9f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:53.409381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 629/1246] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:47:53 2022] GET /identity/v3/role_assignments?user.id=b89a3526406c42819414b773fe8663ff&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=49b518fd6a304c5a9f7b431cea993279 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:47:55.684562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e4e9-c329-4c15-b4a5-15fb2a46ec1c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:55.685093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e4e9-c329-4c15-b4a5-15fb2a46ec1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:55.685093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b330e4e9-c329-4c15-b4a5-15fb2a46ec1c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:55.686388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 618/1247] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:47:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:47:55.693230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:55.694122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:55.694280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:55.700957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:55.717742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:47:55.718975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:47:55.790156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 630/1248] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:47:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:47:55.813970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330e4e9-c329-4c15-b4a5-15fb2a46ec1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:55.835619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:55.934148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b330e4e9-c329-4c15-b4a5-15fb2a46ec1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:55.973002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:55.973909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:55.974246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:55.974726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:55.985785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:47:55.993518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:55.994738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:55.999937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 619/1249] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:47:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:56.001052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:56.124963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7e2b7-01f0-401d-bcc5-b9d14dd0fee7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:56.164265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:56.170970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:56.171665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:56.171993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:56.172253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:56.172951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:56.173253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:56.174684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:56.184097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 631/1250] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:47:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:47:56.190238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:56.277970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:56.307282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bebd5-b280-451d-a71f-9625123798f3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:56.346064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:56.346983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:56.347437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:56.347743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:56.360129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:56.361565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:56.387532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:56.388831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:56.389944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:56.389944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:56.389944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:56.389944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:56.389944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 620/1251] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:56.397621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:56.508239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ff345-b3e7-4905-b051-a5f6cd62800f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:56.546981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:56.547574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:56.547865 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:56.548154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:56.548870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:56.549177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:56.550696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:56.565105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 632/1252] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:56.571019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:56.682101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47a84a-77df-48ff-822a-bbd1da328ae6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:56.715121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:56.724369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:56.725429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:56.725810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:56.726203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:56.735864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:56.737228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:47:56.754216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:56.755557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:47:56.756527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 621/1253] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:56.761938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:56.821938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:56.868179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516085c-83e6-4ece-a2df-e917b4c6397b None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:56.905043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:56.905877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:56.906168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:56.906451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:56.907404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:56.907866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:56.909376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:56.929847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 633/1254] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 09:47:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:47:56.936012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:57.051815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f18c8ac-47ea-4bce-a23f-dff1e6211dec None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:57.085624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:57.086200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:57.086508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:57.086780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:57.147640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:57.161911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:57.163402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:57.269743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 622/1255] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:47:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:47:57.276851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:57.380956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3ffdd-8c93-4a95-b96f-2630016096af None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:57.395043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:57.417752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:57.418573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:57.418866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:57.419101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:57.429335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:57.431076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:47:57.448611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:57.449664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:57.451561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:47:57.451561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:47:57.451561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:47:57.451561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:57.451561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 634/1256] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:47:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:47:57.455981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:57.545910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:57.560197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4787e-ae6c-4fd5-80bb-f5fd193d5f76 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:57.603181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:57.604161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:57.604579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:57.604986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:57.606116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:57.606607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:57.609073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:57.625257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 623/1257] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:47:57.631633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:57.743936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cdfc9-5ff1-4459-96fc-99109a864089 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:57.782031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:57.782910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:57.783312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:57.783599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:57.792505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:57.794315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:47:57.809348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:47:57.810521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:47:57.811772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 635/1258] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:47:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 13 09:47:57.817811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:57.932996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50d58f-5355-4fb5-b6d4-83b36b5eccf3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:57.972334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:57.973021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:57.973302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:57.973572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:57.975162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:57.975475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:57.976989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3dcab-86ec-4b7a-983b-b45a7a529cd2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:57.992162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 624/1259] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:47:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:47:57.998711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:47:58.028184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:47:58.120600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cccc46-0cd4-43a7-b662-19269dc29271 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:47:58.161874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:47:58.163071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:47:58.163356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:47:58.163635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:47:58.164485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=b89a3526406c42819414b773fe8663ff) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:47:58.164801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:47:58.166270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b68ae93-6f31-4ec9-b4e1-98aa79dfb174 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:47:58.172607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 636/1260] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:47:57 2022] GET /identity/v3/role_assignments?user.id=b89a3526406c42819414b773fe8663ff&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=757ccd03cb5e4f109673558436a31b66 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:00.220818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686af68a-5f3c-4133-b508-67e78dc75849 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:00.221442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686af68a-5f3c-4133-b508-67e78dc75849 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:00.221442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686af68a-5f3c-4133-b508-67e78dc75849 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:00.223537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 625/1261] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:48:00.232612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:00.233027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:00.233185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:00.254485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:48:00.255778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:48:00.330841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 637/1262] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:48:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:48:00.354002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686af68a-5f3c-4133-b508-67e78dc75849 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:00.370821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:00.476904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686af68a-5f3c-4133-b508-67e78dc75849 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:00.513315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:00.514099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:00.514384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:00.514691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:00.525765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:48:00.533420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:00.534583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:00.535736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 626/1263] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:48:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:00.540956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:00.560620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:00.644622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84d2bc-3f33-47b7-8f69-bd03824f85ef None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:00.683751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:00.684398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:00.684673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:00.684924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:00.685658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:00.685954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:00.687345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:00.695779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 638/1264] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:48:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:00.705088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:00.782504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:00.822635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3f88b-27ad-4af9-8020-7fbe51568a0d None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:00.858340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:00.859146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:00.859421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:00.859691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:00.872117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:00.873558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:48:00.890858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:00.891914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:00.893017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:48:00.893017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:48:00.893017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:00.893017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:00.893017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 627/1265] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:00.897998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:00.981397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:01.006344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc2aa2-13c1-4a60-8916-5810b4ad9a4d None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:01.042469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:01.043076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:01.043344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:01.043613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:01.044333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:01.044661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:01.046057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:01.059029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 639/1266] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:01.067944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:01.180507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda22a4a-83a6-4a89-a4ca-1b70c79adbe6 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:01.199903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:01.215961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:01.216761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:01.217043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:01.217320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:01.225597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:01.227065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:48:01.241383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:01.242388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:01.243429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 628/1267] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:48:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:01.248656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:01.355549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964efab-1df2-49a1-9d49-f1126f9a9445 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:01.394687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:01.395352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:01.395688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:01.396416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:01.397260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:01.397591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:01.399081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:01.408035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:01.422563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 640/1268] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 09:48:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:01.430059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:01.534651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070245f-b237-4741-8c8c-f46b72ce81b9 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:01.573355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:01.574616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:01.575075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:01.575515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:01.590612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:01.592054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:48:01.610190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:01.611247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:01.612316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:48:01.612316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:48:01.612316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:01.612316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:01.612316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 629/1269] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:01.617303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:01.728928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a55180-721d-4ce3-ad9a-ddd84e0561e6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:01.765704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:01.766354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:01.766658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:01.766929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:01.767648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:01.767972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:01.769358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:01.781017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 641/1270] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:01.788875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:01.822659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:01.907549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed30181-b425-4742-bec5-95208ad91b9a None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:01.943609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:01.944385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:01.944669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:01.944944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:01.952048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:01.953483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:48:01.968364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:01.969376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:01.970562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 630/1271] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:01.975750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:02.037240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:02.081736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2543112-9cb9-4d86-90de-d72c624bc821 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:02.116189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:02.116840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:02.117116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:02.117389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:02.118167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:02.118495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:02.119937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea181b6-1018-4bb3-8869-0fdb3793a579 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:02.132205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 642/1272] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:02.138753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:02.233311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:02.242575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92cce0-ca8a-4134-a9b8-111b4c5156da None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:02.278310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac42f4-31ba-4887-bd17-89fa29c65c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:02.279253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac42f4-31ba-4887-bd17-89fa29c65c80 None admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:02.279533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac42f4-31ba-4887-bd17-89fa29c65c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:02.279813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac42f4-31ba-4887-bd17-89fa29c65c80 None admin] PATH_INFO: `/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/b89a3526406c42819414b773fe8663ff/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:02.281989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac42f4-31ba-4887-bd17-89fa29c65c80 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a38e8abe0ab4906affbfcd35e3a1d04, user_id=b89a3526406c42819414b773fe8663ff, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:02.283438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac42f4-31ba-4887-bd17-89fa29c65c80 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:02.302840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 631/1273] 10.222.0.17 () {58 vars in 1439 bytes} [Wed Jul 13 09:48:02 2022] PUT /identity/v3/projects/5a38e8abe0ab4906affbfcd35e3a1d04/users/b89a3526406c42819414b773fe8663ff/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:48:04.322499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66592-ad8d-4d3e-b665-291e2cabc53e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:04.323400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66592-ad8d-4d3e-b665-291e2cabc53e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:04.323400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f66592-ad8d-4d3e-b665-291e2cabc53e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:04.325664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 643/1274] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:48:04.331774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:04.332212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:04.332336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:04.356919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:48:04.358103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:48:04.430037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 632/1275] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:48:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:48:04.453650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66592-ad8d-4d3e-b665-291e2cabc53e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:04.567926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f66592-ad8d-4d3e-b665-291e2cabc53e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:04.585482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:04.615600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:04.616386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:04.616665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:04.616937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:04.627896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 13 09:48:04.635393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:04.636795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:04.637817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 644/1276] 10.222.0.17 () {56 vars in 1096 bytes} [Wed Jul 13 09:48:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:04.642988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:04.730849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:04.750936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113360-1b42-4229-a177-6dbf7177fbf9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:04.786133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:04.786806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:04.787347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:04.787347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:04.788062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:04.788552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:04.789794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:04.798088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 633/1277] 10.222.0.17 () {56 vars in 1099 bytes} [Wed Jul 13 09:48:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:04.803920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:04.908668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c00231-cbb8-44f1-97d2-75777f8c167f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:04.944002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:04.944794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:04.945075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:04.945347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:04.956543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:04.958068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:48:04.982323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:04.983361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:04.984244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:48:04.984244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:48:04.984244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:04.984244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:04.984244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 645/1278] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:04.989776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:05.103192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a0870-b085-414d-a4c1-f526c5e8a449 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:05.139604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:05.140281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:05.140563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:05.140835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:05.141563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:05.141956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:05.143299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:05.156842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 634/1279] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:05.162672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:05.194441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:05.273171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc9cbff-756b-4b15-b870-919a947fc23f None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:05.312653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:05.313523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:05.313801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:05.314068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:05.321955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:05.323428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 13 09:48:05.337901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:05.339047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:05.340412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 646/1280] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:48:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:05.346441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:05.350717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:05.464405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd43042-a0c0-4612-b312-9c38212dee4f None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:05.502582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:05.503236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:05.503517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:05.503749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:05.504602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:05.504933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:05.506554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:05.525616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 635/1281] 10.222.0.17 () {56 vars in 1143 bytes} [Wed Jul 13 09:48:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:48:05.531598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:05.640291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:05.653576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d36de4-d42f-4d63-ba32-5c20d543c6f6 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:05.689257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:05.689890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:05.690171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:05.690461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:05.762272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:05.763675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:05.857351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:05.869200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 647/1282] 10.222.0.17 () {58 vars in 1282 bytes} [Wed Jul 13 09:48:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 13 09:48:05.878653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:05.944869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:05.984711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10903b3-31c0-4948-9517-d0655a02097b None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:06.022733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:06.023447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:06.023728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:06.024002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:06.035664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:06.037126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 13 09:48:06.056935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:06.057971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:06.059340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 13 09:48:06.059340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 13 09:48:06.059340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 13 09:48:06.059340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:06.059340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 636/1283] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:06.064623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:06.184763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300acba-21b7-46eb-a801-b66585557e05 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:06.224447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:06.225097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:06.225378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:06.225657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:06.226378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:06.226719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:06.228091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:06.240965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 648/1284] 10.222.0.17 () {56 vars in 1109 bytes} [Wed Jul 13 09:48:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:06.246996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:06.352181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4ab2-deaf-4f6e-b5c7-0893a4abd0c3 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:06.367363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:06.396411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:06.397199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:06.397479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:06.397750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:06.404819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:06.406250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 13 09:48:06.420173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:06.421236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: ERROR keystone.server.flask.application Jul 13 09:48:06.422181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 637/1285] 10.222.0.17 () {56 vars in 1111 bytes} [Wed Jul 13 09:48:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:06.428361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:06.490340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:06.568125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74641010-2989-4cd9-95ba-a0f1b037fafe None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:06.603281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:06.603874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:06.604148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:06.604419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:06.605199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:06.605504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:06.607000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8689ebbd-3da2-4a7d-bfb9-e4c673ff99e3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:06.619354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 649/1286] 10.222.0.17 () {56 vars in 1148 bytes} [Wed Jul 13 09:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:06.626651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:06.734679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebdd9c-ef82-4090-a09e-16d7ad980e19 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:06.770529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:06.771158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:06.771436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:06.771707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:06.772518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] RBAC: Adding query filter params (role.id=757ccd03cb5e4f109673558436a31b66, scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04, user.id=b89a3526406c42819414b773fe8663ff) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:06.772828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:06.774232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440789eb-ad21-474f-8598-ecd3616044e9 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:06.780216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 638/1287] 10.222.0.17 () {56 vars in 1374 bytes} [Wed Jul 13 09:48:06 2022] GET /identity/v3/role_assignments?user.id=b89a3526406c42819414b773fe8663ff&scope.project.id=5a38e8abe0ab4906affbfcd35e3a1d04&role.id=757ccd03cb5e4f109673558436a31b66 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:08.793141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661f4a-312f-4c3a-9315-624b32c44352 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:08.793724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661f4a-312f-4c3a-9315-624b32c44352 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:08.793724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2661f4a-312f-4c3a-9315-624b32c44352 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:08.795095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 650/1288] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:48:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:48:08.801303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:08.802207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:08.802716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:08.826666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:48:08.827832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:48:08.861691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:08.908463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 639/1289] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:48:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:48:08.939188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661f4a-312f-4c3a-9315-624b32c44352 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:09.060954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2661f4a-312f-4c3a-9315-624b32c44352 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:09.071810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:09.103210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:09.104153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:09.104468 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:09.104882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:09.105704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:09.107276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:09.120053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:09.121444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:09.122538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 651/1290] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:48:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:09.127635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:09.235470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70485755-faec-42b2-9ac9-424a1ba3d0ae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:09.273073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:09.273741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:09.274024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:09.274293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:09.275033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:09.275336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:09.276703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b52659-320a-4a6a-9b1b-cdab82527a69 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:09.282896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 640/1291] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 09:48:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:09.290044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:09.403137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ed2ce-9a03-4364-a187-f9e8bc79a6d2 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:09.438257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:09.438958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:09.439241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:09.439513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] PATH_INFO: `/v3/services` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:09.440218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:09.440525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:09.441889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774be189-e5cf-4691-a33e-31a1a99f9043 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:09.447008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 652/1292] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 09:48:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:48:11.456437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71abb32-f3c2-4277-85bd-2b630419dc00 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:11.456977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71abb32-f3c2-4277-85bd-2b630419dc00 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:11.456977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71abb32-f3c2-4277-85bd-2b630419dc00 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:11.458496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 641/1293] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:48:11.464673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52c40-c25d-40ec-bf3b-c1ee464e98db None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:11.465107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52c40-c25d-40ec-bf3b-c1ee464e98db None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:11.465244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f52c40-c25d-40ec-bf3b-c1ee464e98db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:11.493853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e3f52c40-c25d-40ec-bf3b-c1ee464e98db None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:48:11.495053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e3f52c40-c25d-40ec-bf3b-c1ee464e98db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:48:11.527191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:11.566696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 653/1294] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:48:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:48:11.601794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71abb32-f3c2-4277-85bd-2b630419dc00 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:11.638974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:11.715476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71abb32-f3c2-4277-85bd-2b630419dc00 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:11.750741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05f47c-319d-4181-82a5-b595e6eed3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:11.751385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05f47c-319d-4181-82a5-b595e6eed3a1 None admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:11.751662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05f47c-319d-4181-82a5-b595e6eed3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:11.751932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05f47c-319d-4181-82a5-b595e6eed3a1 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:11.752639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05f47c-319d-4181-82a5-b595e6eed3a1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:11.753994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05f47c-319d-4181-82a5-b595e6eed3a1 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:11.771019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 642/1295] 10.222.0.17 () {60 vars in 1141 bytes} [Wed Jul 13 09:48:11 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:48:13.853141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309e2a9-d097-4a73-93d1-154238793641 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:13.853700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309e2a9-d097-4a73-93d1-154238793641 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:13.853700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309e2a9-d097-4a73-93d1-154238793641 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:13.855106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 654/1296] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:48:13.861334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:13.861782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:13.861910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:13.887287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:48:13.888478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:48:13.974366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 643/1297] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:48:13 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:48:13.997244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309e2a9-d097-4a73-93d1-154238793641 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:14.130774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309e2a9-d097-4a73-93d1-154238793641 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:14.172498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:14.173693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:14.174190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:14.174706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:14.175766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:14.177575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:14.189557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:14.190727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:14.191722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 655/1298] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:48:13 2022] GET /identity/v3/services/placement => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:14.197311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:14.217021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:14.312971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08256d-5e73-4057-bb41-1684374081cc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:14.349905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:14.350582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:14.350866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:14.351143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:14.351844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:14.352149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:14.353504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:14.359021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 644/1299] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 09:48:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:14.365312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:14.401492 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:14.471520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc10e6d-8edb-42f2-93c4-229a50d2f1d7 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:14.507099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:14.507744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:14.508020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:14.508291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:14.509067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] RBAC: Adding query filter params (interface=public, service_id=fda9070fa07f493ab257b9f4b661b13a, region_id=RegionOne) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:14.509377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:14.510762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26a05bb-1542-4b18-bf91-6adf9be512d3 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:14.516339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 656/1300] 10.222.0.17 () {56 vars in 1251 bytes} [Wed Jul 13 09:48:14 2022] GET /identity/v3/endpoints?service_id=fda9070fa07f493ab257b9f4b661b13a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:14.522344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:14.612246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:14.639390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62abae1-bb58-4264-95a8-00b8582987e0 None admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:14.676501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe80f6-c94e-4f78-8bee-259d322665d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:14.677169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe80f6-c94e-4f78-8bee-259d322665d0 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:14.677450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe80f6-c94e-4f78-8bee-259d322665d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:14.677727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe80f6-c94e-4f78-8bee-259d322665d0 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:14.678408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe80f6-c94e-4f78-8bee-259d322665d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:14.679802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe80f6-c94e-4f78-8bee-259d322665d0 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:14.686829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 645/1301] 10.222.0.17 () {56 vars in 1087 bytes} [Wed Jul 13 09:48:14 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:48:16.730489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e11b-13b9-4ff4-8bb1-01250b5bd0cc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:16.731319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e11b-13b9-4ff4-8bb1-01250b5bd0cc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:16.731454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7e11b-13b9-4ff4-8bb1-01250b5bd0cc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:16.733575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 657/1302] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:48:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:48:16.739916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:16.740355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:16.740444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:16.767794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:48:16.769576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:48:16.840767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 646/1303] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:48:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 13 09:48:16.864928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e11b-13b9-4ff4-8bb1-01250b5bd0cc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:16.978778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:16.991668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7e11b-13b9-4ff4-8bb1-01250b5bd0cc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:17.032283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:17.033070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:17.033346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:17.033619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:17.034254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:17.035897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 13 09:48:17.048544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 13 09:48:17.049696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.get_or_create( Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application with Lock( Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self._enter() Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application return self.creator() Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application created_value = creator( Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: ERROR keystone.server.flask.application Jul 13 09:48:17.051197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 658/1304] 10.222.0.17 () {56 vars in 1117 bytes} [Wed Jul 13 09:48:16 2022] GET /identity/v3/services/placement => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 13 09:48:17.057111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:17.137077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:17.160871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75418da-60e5-45c9-895d-0f7c8aae8586 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:17.200323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:17.200966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:17.201244 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:17.201513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] PATH_INFO: `/v3/services` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:17.202211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:48:17.202545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:17.203900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa636fb5-3e3e-4e1d-a0b9-156b90c74ff2 None admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:17.209561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 647/1305] 10.222.0.17 () {56 vars in 1116 bytes} [Wed Jul 13 09:48:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:48:17.216289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:48:17.333900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a3340f-e4ad-4193-b434-cf76b557c2c4 None admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:48:17.369317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5e0232-360e-4e65-84df-00369d5193be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:48:17.370775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0232-360e-4e65-84df-00369d5193be None admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:48:17.370775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0232-360e-4e65-84df-00369d5193be None admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:48:17.370957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5e0232-360e-4e65-84df-00369d5193be None admin] PATH_INFO: `/v3/endpoints` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:48:17.371979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e0232-360e-4e65-84df-00369d5193be None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:48:17.374152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5e0232-360e-4e65-84df-00369d5193be None admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:48:17.402761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 659/1306] 10.222.0.17 () {60 vars in 1144 bytes} [Wed Jul 13 09:48:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:48:27.206127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=30 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:48:27.397778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:20.471365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db2ac7-fa77-43e6-b07c-7ced892ecc39 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:20.471961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db2ac7-fa77-43e6-b07c-7ced892ecc39 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:20.472262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db2ac7-fa77-43e6-b07c-7ced892ecc39 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:20.477727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 648/1307] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:20.479594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f717-a29d-40d6-9c34-b82385c485ce None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:20.480457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f717-a29d-40d6-9c34-b82385c485ce None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:20.480957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844f717-a29d-40d6-9c34-b82385c485ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:20.565418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a844f717-a29d-40d6-9c34-b82385c485ce None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:20.566656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a844f717-a29d-40d6-9c34-b82385c485ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:20.676742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 660/1308] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:49:20.739383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74f23-edb3-4fa6-92a0-5dbca0ada7b5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:20.739597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74f23-edb3-4fa6-92a0-5dbca0ada7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:20.739838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c74f23-edb3-4fa6-92a0-5dbca0ada7b5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:20.741374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 649/1309] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jul 13 09:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:20.752910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba479b-5f34-43df-82e1-e83c0c59627d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:20.753265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba479b-5f34-43df-82e1-e83c0c59627d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:20.753624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba479b-5f34-43df-82e1-e83c0c59627d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:20.875238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b0ba479b-5f34-43df-82e1-e83c0c59627d None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:20.876450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b0ba479b-5f34-43df-82e1-e83c0c59627d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:20.898950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:20.958137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 661/1310] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jul 13 09:49:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:20.967969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74f23-edb3-4fa6-92a0-5dbca0ada7b5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:20.969697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b8c74f23-edb3-4fa6-92a0-5dbca0ada7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:21.117261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c74f23-edb3-4fa6-92a0-5dbca0ada7b5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:21.200324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:21.200980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:21.201264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:21.201522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:21.203227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:21.262215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:21.322126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:21.323671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f00a1c-7125-45c5-8883-681fa5fbb3f2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:21.343737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 650/1311] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:23.647084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a16e9-1378-47bd-88c8-ca2428752d2f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:23.647621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a16e9-1378-47bd-88c8-ca2428752d2f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:23.647621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a16e9-1378-47bd-88c8-ca2428752d2f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:23.650537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 662/1312] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:23.654856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496874-e113-4cb2-a75b-733d7bc47c52 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:23.655410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496874-e113-4cb2-a75b-733d7bc47c52 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:23.655410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a496874-e113-4cb2-a75b-733d7bc47c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:23.748009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4a496874-e113-4cb2-a75b-733d7bc47c52 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:23.749840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4a496874-e113-4cb2-a75b-733d7bc47c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:23.857665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 651/1313] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:23.908215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eac986-5a8a-487c-aa61-e76d38dd0610 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:23.908428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eac986-5a8a-487c-aa61-e76d38dd0610 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:23.908684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71eac986-5a8a-487c-aa61-e76d38dd0610 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:23.910087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 663/1314] 10.222.0.17 () {54 vars in 964 bytes} [Wed Jul 13 09:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:23.916170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad33b-f8db-4dd1-8333-97de0e5f1c92 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:23.916535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad33b-f8db-4dd1-8333-97de0e5f1c92 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:23.916875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcad33b-f8db-4dd1-8333-97de0e5f1c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:23.928068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:23.999332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0fcad33b-f8db-4dd1-8333-97de0e5f1c92 None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:24.000558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0fcad33b-f8db-4dd1-8333-97de0e5f1c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:24.079564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 652/1315] 10.222.0.17 () {58 vars in 1061 bytes} [Wed Jul 13 09:49:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:49:24.089551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eac986-5a8a-487c-aa61-e76d38dd0610 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:24.091211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-71eac986-5a8a-487c-aa61-e76d38dd0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:24.200360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71eac986-5a8a-487c-aa61-e76d38dd0610 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:24.278548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:24.281177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:24.281827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:24.282116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:24.282388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:24.284746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:24.400359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:24.401822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bd4443-1122-4a3b-8d07-c7bda9ecd809 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:24.422127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 664/1316] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:26.940183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b2b8-7b0b-4ec6-a871-4d1cd02795a4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:26.940941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b2b8-7b0b-4ec6-a871-4d1cd02795a4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:26.941037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6b2b8-7b0b-4ec6-a871-4d1cd02795a4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:26.942868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 653/1317] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:26.948770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749055c-9b95-4f04-ba38-0ce7a9e86a65 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:26.949207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749055c-9b95-4f04-ba38-0ce7a9e86a65 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:26.949400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2749055c-9b95-4f04-ba38-0ce7a9e86a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:27.023274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2749055c-9b95-4f04-ba38-0ce7a9e86a65 None None] MFA Rules not processed for user `94b99e0fd4694c7c9aaebeb2b195eb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:27.024481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2749055c-9b95-4f04-ba38-0ce7a9e86a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:27.081823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:27.127191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 665/1318] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:26 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:27.166780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b2b8-7b0b-4ec6-a871-4d1cd02795a4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:27.168347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-65f6b2b8-7b0b-4ec6-a871-4d1cd02795a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:27.296040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6b2b8-7b0b-4ec6-a871-4d1cd02795a4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:27.299025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:27.393277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:27.393962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:27.394246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:27.394557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:27.396189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:27.524847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:27.526318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce33465-2a18-469a-95e4-4f456a63c074 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:27.545295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 654/1319] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:30.225480 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f845b-a20a-4e83-b48e-ce1cee44d6be None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:30.226320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f845b-a20a-4e83-b48e-ce1cee44d6be None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:30.226320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f845b-a20a-4e83-b48e-ce1cee44d6be None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:30.228786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 666/1320] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:30.235142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04249d-35ab-476b-9772-c509418305f3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:30.235883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04249d-35ab-476b-9772-c509418305f3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:30.236094 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04249d-35ab-476b-9772-c509418305f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:30.280004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:30.307970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8c04249d-35ab-476b-9772-c509418305f3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:30.309121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c04249d-35ab-476b-9772-c509418305f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:30.423268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 655/1321] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:30.465039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f845b-a20a-4e83-b48e-ce1cee44d6be None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:30.467448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd8f845b-a20a-4e83-b48e-ce1cee44d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:30.581113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f845b-a20a-4e83-b48e-ce1cee44d6be None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:30.657702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:30.658382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:30.658686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:30.658955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:30.660580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:30.668271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:30.774503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:30.775939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a566-26a6-4363-8238-c0e41c03d5b1 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:30.801515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 667/1322] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:33.747379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c262f08-ed10-47c6-909d-8b2212ea0679 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:33.747993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c262f08-ed10-47c6-909d-8b2212ea0679 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:33.747993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c262f08-ed10-47c6-909d-8b2212ea0679 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:33.749272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 656/1323] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:33.754705 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b7da-8583-4bce-b8e8-fae01cd35669 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:33.755177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b7da-8583-4bce-b8e8-fae01cd35669 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:33.755281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa8b7da-8583-4bce-b8e8-fae01cd35669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:33.823204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7fa8b7da-8583-4bce-b8e8-fae01cd35669 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:33.824421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7fa8b7da-8583-4bce-b8e8-fae01cd35669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:33.887443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:33.936908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 668/1324] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:33.974357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c262f08-ed10-47c6-909d-8b2212ea0679 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:33.975929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5c262f08-ed10-47c6-909d-8b2212ea0679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:34.096252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c262f08-ed10-47c6-909d-8b2212ea0679 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:34.109013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:34.178633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:34.179287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:34.179568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:34.179880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:34.181511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:34.300560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:34.301896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d91a39-bc7e-49e2-b6a2-4ca9297ae74c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:34.321448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 657/1325] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:36.371017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56938a6-efbe-4194-87b3-e5078daf2881 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:36.371392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56938a6-efbe-4194-87b3-e5078daf2881 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:36.371392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56938a6-efbe-4194-87b3-e5078daf2881 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:36.372734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 669/1326] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:36.378151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db09e96-61ff-4469-82f7-ad531f83d58d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:36.378653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db09e96-61ff-4469-82f7-ad531f83d58d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:36.378740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db09e96-61ff-4469-82f7-ad531f83d58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:36.428198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:36.446761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7db09e96-61ff-4469-82f7-ad531f83d58d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:36.448007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7db09e96-61ff-4469-82f7-ad531f83d58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:36.548867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 658/1327] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:36.584513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56938a6-efbe-4194-87b3-e5078daf2881 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:36.586125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d56938a6-efbe-4194-87b3-e5078daf2881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:36.699197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56938a6-efbe-4194-87b3-e5078daf2881 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:36.779941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:36.780589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:36.780864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:36.781136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:36.783259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:36.800696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:36.898235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:36.899715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a30554-7acc-40b2-b183-da4819d08150 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:36.919748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 670/1328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:39.020632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6445-2c89-431a-a169-b3365329f5f4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:39.021191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6445-2c89-431a-a169-b3365329f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:39.021191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6445-2c89-431a-a169-b3365329f5f4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:39.022476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 659/1329] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:39.028152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1e590-6ff6-4d83-b49c-fb1b7970462d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:39.028618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1e590-6ff6-4d83-b49c-fb1b7970462d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:39.028721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1e590-6ff6-4d83-b49c-fb1b7970462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:39.102026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-87d1e590-6ff6-4d83-b49c-fb1b7970462d None None] MFA Rules not processed for user `94b99e0fd4694c7c9aaebeb2b195eb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:39.103328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-87d1e590-6ff6-4d83-b49c-fb1b7970462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:39.173631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:39.207295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 671/1330] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:39.244698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b6445-2c89-431a-a169-b3365329f5f4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:39.246267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-882b6445-2c89-431a-a169-b3365329f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:39.359309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b6445-2c89-431a-a169-b3365329f5f4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:39.384093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:39.438892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:39.439559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:39.439835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:39.440104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:39.441717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:39.575528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:39.576986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53cdba-aa45-4fe9-a1cd-8f3bdcbbb4ba service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:39.597339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 660/1331] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:41.888573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0af34a-d4ba-4a09-b15d-683869e8cdc6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:41.889156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0af34a-d4ba-4a09-b15d-683869e8cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:41.889156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0af34a-d4ba-4a09-b15d-683869e8cdc6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:41.891293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 672/1332] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:41.897160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58383-b421-4b06-8145-a98a66e3ddf7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:41.897539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58383-b421-4b06-8145-a98a66e3ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:41.897715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec58383-b421-4b06-8145-a98a66e3ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:41.966248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:41.969360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1ec58383-b421-4b06-8145-a98a66e3ddf7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:41.971570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ec58383-b421-4b06-8145-a98a66e3ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:42.089045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 661/1333] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:42.124564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0af34a-d4ba-4a09-b15d-683869e8cdc6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:42.126162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c0af34a-d4ba-4a09-b15d-683869e8cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:42.239228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0af34a-d4ba-4a09-b15d-683869e8cdc6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:42.322357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:42.323030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:42.323306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:42.323576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:42.325200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:42.354833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:42.449064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:42.450457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e75ed-1ed2-4353-be47-c80a83202c6e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:42.469317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 673/1334] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:44.511192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935b11-0995-40d6-b25d-f246592d3e80 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:44.512205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935b11-0995-40d6-b25d-f246592d3e80 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:44.512205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20935b11-0995-40d6-b25d-f246592d3e80 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:44.514316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 662/1335] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:44.521777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a45f-c2e3-4466-bf1d-059def0a576a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:44.522210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a45f-c2e3-4466-bf1d-059def0a576a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:44.522354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536a45f-c2e3-4466-bf1d-059def0a576a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:44.595846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e536a45f-c2e3-4466-bf1d-059def0a576a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:44.597037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e536a45f-c2e3-4466-bf1d-059def0a576a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:44.683981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:44.710029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 674/1336] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:44.753038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935b11-0995-40d6-b25d-f246592d3e80 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:44.754618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-20935b11-0995-40d6-b25d-f246592d3e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:44.870434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20935b11-0995-40d6-b25d-f246592d3e80 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:44.903000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:44.952108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:44.952757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:44.953045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:44.953320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:44.955136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:45.073251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:45.074728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece4b10-5b62-42da-89d9-8d2095683122 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:45.095275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 663/1337] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:47.459322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739efe-e2af-4ece-a97f-479ca34b08eb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:47.460229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739efe-e2af-4ece-a97f-479ca34b08eb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:47.460229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739efe-e2af-4ece-a97f-479ca34b08eb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:47.462476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 675/1338] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:47.472002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb225c-a637-42ab-af67-1a02da7cbb58 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:47.472754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb225c-a637-42ab-af67-1a02da7cbb58 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:47.472866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb225c-a637-42ab-af67-1a02da7cbb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:47.552853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7bfb225c-a637-42ab-af67-1a02da7cbb58 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:47.554063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7bfb225c-a637-42ab-af67-1a02da7cbb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:47.563001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:47.657253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 664/1339] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:47 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:47.694939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739efe-e2af-4ece-a97f-479ca34b08eb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:47.697384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e7739efe-e2af-4ece-a97f-479ca34b08eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:47.820241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739efe-e2af-4ece-a97f-479ca34b08eb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:47.906079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:47.906759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:47.907042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:47.907714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:47.908975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:47.944747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:48.024287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:48.025717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2661b1aa-92ae-4ec3-b596-7ebbbf19cbd6 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:48.044490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 676/1340] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:47 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:52.150310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148d59-4d5b-4f1b-ba26-41dae3b1232f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:52.150845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148d59-4d5b-4f1b-ba26-41dae3b1232f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:52.150845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148d59-4d5b-4f1b-ba26-41dae3b1232f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:52.152117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 665/1341] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:52.157401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d3d3-c0cf-44c0-8ca8-6b9c9ac0d4b5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:52.157862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d3d3-c0cf-44c0-8ca8-6b9c9ac0d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:52.157964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252d3d3-c0cf-44c0-8ca8-6b9c9ac0d4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:52.223722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f252d3d3-c0cf-44c0-8ca8-6b9c9ac0d4b5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:52.224908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f252d3d3-c0cf-44c0-8ca8-6b9c9ac0d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:52.316101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:52.327681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 677/1342] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:52.368712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148d59-4d5b-4f1b-ba26-41dae3b1232f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:52.370460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b2148d59-4d5b-4f1b-ba26-41dae3b1232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:52.488718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148d59-4d5b-4f1b-ba26-41dae3b1232f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:52.530281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:52.567908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:52.568558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:52.568835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:52.569107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:52.570789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:52.686013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:52.687474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1f7a4-1473-467d-9d5d-424312c85523 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:52.706613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 666/1343] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:49:55.362186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b23421-3a08-4397-97db-2cbd6e4b9045 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:55.362809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b23421-3a08-4397-97db-2cbd6e4b9045 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:55.362809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b23421-3a08-4397-97db-2cbd6e4b9045 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:55.368347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 678/1344] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:49:55.370442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4a4d7-4148-4a8e-a2ea-f1a5a61b0a33 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:55.370960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4a4d7-4148-4a8e-a2ea-f1a5a61b0a33 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:55.371177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4a4d7-4148-4a8e-a2ea-f1a5a61b0a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:55.446202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-66e4a4d7-4148-4a8e-a2ea-f1a5a61b0a33 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:49:55.447482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-66e4a4d7-4148-4a8e-a2ea-f1a5a61b0a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:55.467427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:55.552450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 667/1345] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:49:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:49:55.596145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b23421-3a08-4397-97db-2cbd6e4b9045 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:49:55.597726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e0b23421-3a08-4397-97db-2cbd6e4b9045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:55.708260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b23421-3a08-4397-97db-2cbd6e4b9045 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:49:55.785499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:49:55.786151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:49:55.786444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:49:55.786741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:49:55.788384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:49:55.833542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:49:55.902400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:49:55.903864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dee99f-caa7-4a33-abc2-ee2b5847e45f service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:49:55.922784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 679/1346] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:49:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:00.221376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0107157-6812-4f85-aa44-d3661c7a8154 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:00.221887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0107157-6812-4f85-aa44-d3661c7a8154 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:00.221994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0107157-6812-4f85-aa44-d3661c7a8154 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:00.223846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 668/1347] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:00.228943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62f14-dd15-4742-bffd-d54c46f2ad6d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:00.229454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62f14-dd15-4742-bffd-d54c46f2ad6d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:00.229454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd62f14-dd15-4742-bffd-d54c46f2ad6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:00.304916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ebd62f14-dd15-4742-bffd-d54c46f2ad6d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:00.306239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ebd62f14-dd15-4742-bffd-d54c46f2ad6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:00.417174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:00.422811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 680/1348] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:00.458236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0107157-6812-4f85-aa44-d3661c7a8154 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:00.459715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a0107157-6812-4f85-aa44-d3661c7a8154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:00.580967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0107157-6812-4f85-aa44-d3661c7a8154 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:00.632338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:00.662592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:00.663259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:00.663546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:00.663826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:00.665492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:00.779592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:00.781034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d8846-d11d-459f-b571-818adc0291dd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:00.799689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 669/1349] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:05.831005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed18e1-aa76-4b56-a874-9392525fe066 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:05.831005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed18e1-aa76-4b56-a874-9392525fe066 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:05.831670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed18e1-aa76-4b56-a874-9392525fe066 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:05.834667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 681/1350] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:05.840290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc5b79-0ad8-4478-abcd-144f07a26206 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:05.840716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc5b79-0ad8-4478-abcd-144f07a26206 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:05.841073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc5b79-0ad8-4478-abcd-144f07a26206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:05.923864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fbcc5b79-0ad8-4478-abcd-144f07a26206 None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:05.925115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fbcc5b79-0ad8-4478-abcd-144f07a26206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:05.990922 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:06.048249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 670/1351] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:50:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:50:10.190723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac5d2-bdb0-40ab-874e-bb987881bad5 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:10.191759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac5d2-bdb0-40ab-874e-bb987881bad5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:10.192006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bac5d2-bdb0-40ab-874e-bb987881bad5 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:10.193633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 682/1352] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:10.199020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa55a-1899-4988-9939-8fe482efc7e0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:10.199445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa55a-1899-4988-9939-8fe482efc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:10.199556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2aa55a-1899-4988-9939-8fe482efc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:10.279167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3f2aa55a-1899-4988-9939-8fe482efc7e0 None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:10.280560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3f2aa55a-1899-4988-9939-8fe482efc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:10.375172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:10.414254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 671/1353] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:50:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:11.562350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d069ee-f664-4f2d-b25b-20d3c95cbce4 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:11.562977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d069ee-f664-4f2d-b25b-20d3c95cbce4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:11.563291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d069ee-f664-4f2d-b25b-20d3c95cbce4 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:11.564882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 683/1354] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:11.570773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf1178-0c9b-4538-bc78-a273cb67d230 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:11.571235 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf1178-0c9b-4538-bc78-a273cb67d230 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:11.571337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf1178-0c9b-4538-bc78-a273cb67d230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:11.649135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b7cf1178-0c9b-4538-bc78-a273cb67d230 None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:11.650238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7cf1178-0c9b-4538-bc78-a273cb67d230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:11.757572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 672/1355] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:50:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:15.259452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431212b-3a62-4ddf-9905-dd5b06664d7b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:15.260447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431212b-3a62-4ddf-9905-dd5b06664d7b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:15.260921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7431212b-3a62-4ddf-9905-dd5b06664d7b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:15.263943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 684/1356] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:15.268110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f367-345d-4a78-b031-e8ac0502e946 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:15.269080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f367-345d-4a78-b031-e8ac0502e946 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:15.269676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f367-345d-4a78-b031-e8ac0502e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:15.315144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:15.356285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d342f367-345d-4a78-b031-e8ac0502e946 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:15.357515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d342f367-345d-4a78-b031-e8ac0502e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:15.474037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 673/1357] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:15.528309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f31066-91b3-477c-a624-0075373ca8fc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:15.528836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f31066-91b3-477c-a624-0075373ca8fc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:15.529419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f31066-91b3-477c-a624-0075373ca8fc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:15.534026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 685/1358] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 09:50:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:15.540849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa28d0d-e9bf-41fe-8ff1-15203d0a0486 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:15.541150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa28d0d-e9bf-41fe-8ff1-15203d0a0486 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:15.541429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa28d0d-e9bf-41fe-8ff1-15203d0a0486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:15.626096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-afa28d0d-e9bf-41fe-8ff1-15203d0a0486 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:15.627486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-afa28d0d-e9bf-41fe-8ff1-15203d0a0486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:15.683668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:15.764004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 674/1359] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 09:50:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:50:15.772955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f31066-91b3-477c-a624-0075373ca8fc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:15.774507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-97f31066-91b3-477c-a624-0075373ca8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:15.928364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f31066-91b3-477c-a624-0075373ca8fc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:16.015084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:16.057540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:16.058333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:16.058635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:16.058913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:16.060544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:16.161662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:16.163426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ccc12-444b-43c5-b62b-79567fff5129 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:16.182481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 686/1360] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:18.436417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926338e-e4d4-4770-baf6-51a513f9050c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:18.436962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926338e-e4d4-4770-baf6-51a513f9050c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:18.436962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926338e-e4d4-4770-baf6-51a513f9050c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:18.442255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 675/1361] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:18.443996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8fb8-1ea1-49fc-a5ab-2d132ba864d2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:18.444449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8fb8-1ea1-49fc-a5ab-2d132ba864d2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:18.444535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e8fb8-1ea1-49fc-a5ab-2d132ba864d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:18.516194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-059e8fb8-1ea1-49fc-a5ab-2d132ba864d2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:18.517427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-059e8fb8-1ea1-49fc-a5ab-2d132ba864d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:18.559202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:18.630454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 687/1362] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:18.677577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926338e-e4d4-4770-baf6-51a513f9050c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:18.679390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3926338e-e4d4-4770-baf6-51a513f9050c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:18.870058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926338e-e4d4-4770-baf6-51a513f9050c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:18.903032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:19.019551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:19.020307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:19.020659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:19.021005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:19.022893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:19.119468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:19.121090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61c3ac-31e0-4f5f-be18-7f585d6b0ff1 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:19.140245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 676/1363] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:21.491351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24ab22-90be-41ec-9490-7221009c8b16 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:21.491906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24ab22-90be-41ec-9490-7221009c8b16 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:21.492011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24ab22-90be-41ec-9490-7221009c8b16 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:21.493832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 688/1364] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:21.499712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c54c-4b7c-4b29-874a-51132ac02a63 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:21.500195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c54c-4b7c-4b29-874a-51132ac02a63 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:21.500535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72c54c-4b7c-4b29-874a-51132ac02a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:21.516404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:21.576545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bf72c54c-4b7c-4b29-874a-51132ac02a63 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:21.578038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf72c54c-4b7c-4b29-874a-51132ac02a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:21.682983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 677/1365] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:21.727167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f10e-da47-487b-9abd-3a0c45b2feda None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:21.727442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f10e-da47-487b-9abd-3a0c45b2feda None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:21.727686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c143f10e-da47-487b-9abd-3a0c45b2feda None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:21.729201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 689/1366] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 09:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:21.734933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf513b0-8887-4aef-a4a4-bb6b423bbd2a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:21.735334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf513b0-8887-4aef-a4a4-bb6b423bbd2a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:21.735711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf513b0-8887-4aef-a4a4-bb6b423bbd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:21.816533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8bf513b0-8887-4aef-a4a4-bb6b423bbd2a None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:21.818004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8bf513b0-8887-4aef-a4a4-bb6b423bbd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:21.856045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:21.952955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 678/1367] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 09:50:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:21.961828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f10e-da47-487b-9abd-3a0c45b2feda None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:21.963858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c143f10e-da47-487b-9abd-3a0c45b2feda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:22.138288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c143f10e-da47-487b-9abd-3a0c45b2feda None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:22.161357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:22.260824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:22.261483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:22.261770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:22.262050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:22.265244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:22.366190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:22.367344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17afb93-9168-48b4-b6a1-b448d0ed680e service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:22.389630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 690/1368] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:23.310632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83119a-7c5f-41e2-a536-fb5b4ee39c55 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:23.311223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83119a-7c5f-41e2-a536-fb5b4ee39c55 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:23.311223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83119a-7c5f-41e2-a536-fb5b4ee39c55 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:23.312813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 679/1369] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:50:23.317929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1268a5-6f25-4fa0-b6a8-9fbe448013c2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:23.318461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1268a5-6f25-4fa0-b6a8-9fbe448013c2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:23.318567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1268a5-6f25-4fa0-b6a8-9fbe448013c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:23.350854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:23.392892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9a1268a5-6f25-4fa0-b6a8-9fbe448013c2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:23.394111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9a1268a5-6f25-4fa0-b6a8-9fbe448013c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:23.497828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 691/1370] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:23.839337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e5633-2dcf-436b-93e5-03783b10213d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:23.839612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e5633-2dcf-436b-93e5-03783b10213d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:23.839926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e5633-2dcf-436b-93e5-03783b10213d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:23.841475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 680/1371] 10.222.0.17 () {54 vars in 963 bytes} [Wed Jul 13 09:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:23.846697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4f13-6a0c-4536-9727-c813a0a02ce3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:23.847219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4f13-6a0c-4536-9727-c813a0a02ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:23.847602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6a4f13-6a0c-4536-9727-c813a0a02ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:23.929652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2e6a4f13-6a0c-4536-9727-c813a0a02ce3 None None] MFA Rules not processed for user `50bda80f77ff46908f3011622beb3e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:23.931152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2e6a4f13-6a0c-4536-9727-c813a0a02ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:23.984959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:24.018481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 692/1372] 10.222.0.17 () {58 vars in 1060 bytes} [Wed Jul 13 09:50:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:24.026214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e5633-2dcf-436b-93e5-03783b10213d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:24.027880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d1e5633-2dcf-436b-93e5-03783b10213d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:24.142055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e5633-2dcf-436b-93e5-03783b10213d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:24.189105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:24.227587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:24.228339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:24.228599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:24.228888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:24.230688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:24.357681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:24.359712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eadc0-1545-4f66-9f34-ba34f27bde69 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:24.386062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 681/1373] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:50:24.581496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9850b29-eea6-4e84-821a-8c985be8deed None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:24.581924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9850b29-eea6-4e84-821a-8c985be8deed None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:24.582141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9850b29-eea6-4e84-821a-8c985be8deed None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:24.583412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 693/1374] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:24.589683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab4c92-07f0-4cb8-adcc-db8131063f08 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:24.590229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab4c92-07f0-4cb8-adcc-db8131063f08 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:24.590799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab4c92-07f0-4cb8-adcc-db8131063f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:24.667784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-23ab4c92-07f0-4cb8-adcc-db8131063f08 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:24.669007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23ab4c92-07f0-4cb8-adcc-db8131063f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:24.694120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:24.778562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 682/1375] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:24.823014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9850b29-eea6-4e84-821a-8c985be8deed None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:24.824552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b9850b29-eea6-4e84-821a-8c985be8deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:24.979440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9850b29-eea6-4e84-821a-8c985be8deed None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:25.035687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:25.101853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:25.102799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:25.103056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:25.103360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:25.105268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:25.202009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:25.203688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9e22-7bf6-4bb6-b4bc-6a5dc86a4ecb service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:25.222378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 694/1376] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:27.283578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bdba2-ceb3-4686-9640-fb956f5c906c None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:27.284139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bdba2-ceb3-4686-9640-fb956f5c906c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:27.284139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2bdba2-ceb3-4686-9640-fb956f5c906c None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:27.285536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 683/1377] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:27.291284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d9dc7-bbaf-4d04-9976-4c41dbdc5182 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:27.291722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d9dc7-bbaf-4d04-9976-4c41dbdc5182 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:27.291883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d9dc7-bbaf-4d04-9976-4c41dbdc5182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:27.357989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-702d9dc7-bbaf-4d04-9976-4c41dbdc5182 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:27.360518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-702d9dc7-bbaf-4d04-9976-4c41dbdc5182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:27.371703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:27.478679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 695/1378] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:27.522595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bdba2-ceb3-4686-9640-fb956f5c906c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:27.524207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c2bdba2-ceb3-4686-9640-fb956f5c906c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:27.677384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2bdba2-ceb3-4686-9640-fb956f5c906c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:27.681145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:27.796373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:27.796373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:27.796373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:27.798635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:27.798635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:27.909166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:27.910831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee48fa3-a9f9-4300-a893-01a6e6486868 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:27.936517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 684/1379] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:30.061623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77e60-a94d-4a84-a2a1-e1e01812290d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:30.062387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77e60-a94d-4a84-a2a1-e1e01812290d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:30.062387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a77e60-a94d-4a84-a2a1-e1e01812290d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:30.066083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 696/1380] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:30.069527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf462c6-1886-4295-b8eb-5fe47ead4518 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:30.070044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf462c6-1886-4295-b8eb-5fe47ead4518 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:30.070044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf462c6-1886-4295-b8eb-5fe47ead4518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:30.081115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:30.143417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-faf462c6-1886-4295-b8eb-5fe47ead4518 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:30.144597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-faf462c6-1886-4295-b8eb-5fe47ead4518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:30.249869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 685/1381] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:30.293867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a77e60-a94d-4a84-a2a1-e1e01812290d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:30.295837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2a77e60-a94d-4a84-a2a1-e1e01812290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:30.477536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:30.489613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a77e60-a94d-4a84-a2a1-e1e01812290d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:30.617583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:30.618317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:30.618725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:30.619226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:30.620991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:30.734196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:30.735910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf28c0f-144a-47a9-baa1-64f80f73050f service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:30.749884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:30.763116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 697/1382] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:32.852844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557094a2-8e68-410a-aa49-82937b1fd1a7 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:32.853568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557094a2-8e68-410a-aa49-82937b1fd1a7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:32.853568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557094a2-8e68-410a-aa49-82937b1fd1a7 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:32.854812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 686/1383] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:32.861225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c793619-e27f-4c1f-a18b-db38bba77337 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:32.861978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c793619-e27f-4c1f-a18b-db38bba77337 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:32.862085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c793619-e27f-4c1f-a18b-db38bba77337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:32.936272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7c793619-e27f-4c1f-a18b-db38bba77337 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:32.937734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7c793619-e27f-4c1f-a18b-db38bba77337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:33.048479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 698/1384] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:33.093484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557094a2-8e68-410a-aa49-82937b1fd1a7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:33.095286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-557094a2-8e68-410a-aa49-82937b1fd1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:33.194058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:33.259308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557094a2-8e68-410a-aa49-82937b1fd1a7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:33.392941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:33.393667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:33.393945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:33.394239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:33.396449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:33.451916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:33.497983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:33.500033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f7d0a-9240-41c8-87aa-446a6edb669f service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:33.520740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 687/1385] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:35.761318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbe9d-605e-4786-85d5-0a427dc835b8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:35.762042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbe9d-605e-4786-85d5-0a427dc835b8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:35.762042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbe9d-605e-4786-85d5-0a427dc835b8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:35.763490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 699/1386] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:35.769652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4314f-eff5-4404-9a6f-b47fb53e1537 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:35.770189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4314f-eff5-4404-9a6f-b47fb53e1537 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:35.770372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4314f-eff5-4404-9a6f-b47fb53e1537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:35.843834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1ac4314f-eff5-4404-9a6f-b47fb53e1537 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:35.845421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ac4314f-eff5-4404-9a6f-b47fb53e1537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:35.959620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 688/1387] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:36.015279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbe9d-605e-4786-85d5-0a427dc835b8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:36.016943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-db1dbe9d-605e-4786-85d5-0a427dc835b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:36.110153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:36.195023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbe9d-605e-4786-85d5-0a427dc835b8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:36.336533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:36.337150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:36.337489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:36.337838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:36.340213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:36.388426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:36.468309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:36.471319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e18cdee-c097-4c77-94a2-86f5369e3d76 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:36.504445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 700/1388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:50:38.751743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a860-5c3a-4e90-b9d2-cd6bd565358f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:38.752617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a860-5c3a-4e90-b9d2-cd6bd565358f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:38.752617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72a860-5c3a-4e90-b9d2-cd6bd565358f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:38.754257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 689/1389] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:38.760963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead9a2-000e-48a0-aff8-2a230bcd9909 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:38.761455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead9a2-000e-48a0-aff8-2a230bcd9909 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:38.761967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deead9a2-000e-48a0-aff8-2a230bcd9909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:38.853009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-deead9a2-000e-48a0-aff8-2a230bcd9909 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:38.854281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-deead9a2-000e-48a0-aff8-2a230bcd9909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:38.994954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 701/1390] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:39.050860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a860-5c3a-4e90-b9d2-cd6bd565358f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:39.052485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7e72a860-5c3a-4e90-b9d2-cd6bd565358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:39.089077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:39.218203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72a860-5c3a-4e90-b9d2-cd6bd565358f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:39.322877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:39.335560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:39.336209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:39.336493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:39.336772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:39.338377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:39.433775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:39.435406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd0fcf-8878-4bfc-b3fc-294345ec844a service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:39.454703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 690/1391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:41.132079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9c65-af7e-47c9-a20e-235932e31532 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.132674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9c65-af7e-47c9-a20e-235932e31532 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.132674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb9c65-af7e-47c9-a20e-235932e31532 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.134349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 702/1392] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:41.139847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ccb14-7a4f-41d1-9f1d-2a0501954a38 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.140609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ccb14-7a4f-41d1-9f1d-2a0501954a38 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.140917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ccb14-7a4f-41d1-9f1d-2a0501954a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.209629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cf1ccb14-7a4f-41d1-9f1d-2a0501954a38 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:41.210990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cf1ccb14-7a4f-41d1-9f1d-2a0501954a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:41.272175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:41.310521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 691/1393] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:41.365451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1a12-3174-4d1a-9813-3eaec078e3f7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.365719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1a12-3174-4d1a-9813-3eaec078e3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.365981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1a12-3174-4d1a-9813-3eaec078e3f7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.367696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 703/1394] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 13 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:41.372890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.373179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.373451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.453494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] MFA Rules not processed for user `2947dfd2c2b14daf9c16e534b0139da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:41.454735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:41.488948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb697-0f21-4930-8915-f62e5863d2f2 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.488948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb697-0f21-4930-8915-f62e5863d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.489178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02adb697-0f21-4930-8915-f62e5863d2f2 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.493001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 704/1395] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:50:41.496342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.496635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.496933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.517628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:41.545696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 692/1396] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 13 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:41.553537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:41.563336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc52378-45fc-4dde-9cc4-4bc190c3789d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:41.581120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:41.582333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:41.617762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:41.641812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:41.642494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.642764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.643038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.644676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:41.684754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 705/1397] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:50:41.728254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:41.729459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:41.759257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:41.760692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0f872-b07c-4b25-ad7e-b8b14dc605fb service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:41.779068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 693/1398] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:50:41.822048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:41.848560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ffe08-7313-46c7-ae02-edb9d031f01e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:41.961712 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:41.962362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:41.962668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:41.962940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:41.964592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:42.065973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:42.070195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:42.072009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c7da08-841b-4d2f-b1ec-77b6add5f47c service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:42.094340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 706/1399] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:50:42.516477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372c69-34ec-4fa3-bf0d-ad3750844dda None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:42.516971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372c69-34ec-4fa3-bf0d-ad3750844dda None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:42.517090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1372c69-34ec-4fa3-bf0d-ad3750844dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:42.586906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c1372c69-34ec-4fa3-bf0d-ad3750844dda None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:42.588237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c1372c69-34ec-4fa3-bf0d-ad3750844dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:42.626407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:42.682040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 694/1400] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:50:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:42.729333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0e66-299c-4380-a5e8-6a2b67204b2f None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:42.729889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0e66-299c-4380-a5e8-6a2b67204b2f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:42.729889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b0e66-299c-4380-a5e8-6a2b67204b2f None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:42.731334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 707/1401] 10.222.0.17 () {54 vars in 942 bytes} [Wed Jul 13 09:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:42.738165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e7ef-2ff4-4e6f-a8d6-41b97951f475 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:42.740733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e7ef-2ff4-4e6f-a8d6-41b97951f475 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:42.740733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e7ef-2ff4-4e6f-a8d6-41b97951f475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:42.820246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b8b4e7ef-2ff4-4e6f-a8d6-41b97951f475 None None] MFA Rules not processed for user `ad683d737d594402850ef0af27d6e103`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:42.821467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b8b4e7ef-2ff4-4e6f-a8d6-41b97951f475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:42.933243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 695/1402] 10.222.0.17 () {58 vars in 1039 bytes} [Wed Jul 13 09:50:42 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:42.942877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0e66-299c-4380-a5e8-6a2b67204b2f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:42.944381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d04b0e66-299c-4380-a5e8-6a2b67204b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:43.092863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b0e66-299c-4380-a5e8-6a2b67204b2f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:43.171461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:43.205755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:43.206456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:43.206750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:43.207019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:43.208724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:43.298075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:43.299701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b53fd5-ee6b-4179-b783-529603f33500 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:43.308400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 708/1403] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 09:50:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:50:44.165141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8381-4de5-440e-a323-71b6a56dcee6 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:44.165680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8381-4de5-440e-a323-71b6a56dcee6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:44.165680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddd8381-4de5-440e-a323-71b6a56dcee6 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:44.167128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 696/1404] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:44.172414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccf5c1-bc9c-4031-a79e-51ed6a73409c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:44.172863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccf5c1-bc9c-4031-a79e-51ed6a73409c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:44.172959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccf5c1-bc9c-4031-a79e-51ed6a73409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:44.248459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-87ccf5c1-bc9c-4031-a79e-51ed6a73409c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:44.251037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-87ccf5c1-bc9c-4031-a79e-51ed6a73409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:44.319625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:44.373963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 709/1405] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:44.427044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8381-4de5-440e-a323-71b6a56dcee6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:44.428913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eddd8381-4de5-440e-a323-71b6a56dcee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:44.437588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:44.611774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddd8381-4de5-440e-a323-71b6a56dcee6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:44.703039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:44.745791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:44.746501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:44.746778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:44.747043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:44.748792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:44.854435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:44.857067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83381def-3e83-4ff3-8e82-747ae24d6591 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:44.877843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 697/1406] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:47.024805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b9a1-dd29-4c31-97a2-f600e19708fb None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:47.025806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b9a1-dd29-4c31-97a2-f600e19708fb None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:47.026291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20b9a1-dd29-4c31-97a2-f600e19708fb None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:47.027979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 710/1407] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:50:47.035672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c6df-faf7-4863-a169-b251e055e2e9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:47.036227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c6df-faf7-4863-a169-b251e055e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:47.036227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31c6df-faf7-4863-a169-b251e055e2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:47.109352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fb31c6df-faf7-4863-a169-b251e055e2e9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:50:47.110658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fb31c6df-faf7-4863-a169-b251e055e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:47.172509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:47.254900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 698/1408] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:50:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:50:47.300508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b9a1-dd29-4c31-97a2-f600e19708fb None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:50:47.302193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8e20b9a1-dd29-4c31-97a2-f600e19708fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:47.470426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20b9a1-dd29-4c31-97a2-f600e19708fb None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:50:47.524999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:47.612314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:50:47.613237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:50:47.613592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:50:47.614099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:50:47.615924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:50:47.719074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:50:47.720688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f589ffb-39b0-44da-85ff-d3388c178d33 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:50:47.739344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 711/1409] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:50:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:50:57.252770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=24 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:50:57.736780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=78 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:05.378892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd50b-4c8a-4c84-836b-9af5513d8f8b None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:05.379372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd50b-4c8a-4c84-836b-9af5513d8f8b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:05.379474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bdd50b-4c8a-4c84-836b-9af5513d8f8b None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:05.381616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 699/1410] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jul 13 09:51:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:05.387225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2212eec-c7de-43e8-9a55-7469c5009aa4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:05.387671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2212eec-c7de-43e8-9a55-7469c5009aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:05.387777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2212eec-c7de-43e8-9a55-7469c5009aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:05.469008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b2212eec-c7de-43e8-9a55-7469c5009aa4 None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:05.470197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b2212eec-c7de-43e8-9a55-7469c5009aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:05.593795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 712/1411] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jul 13 09:51:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:05.608632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9c7f-139f-4886-a235-709e96edb5c4 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:05.608923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9c7f-139f-4886-a235-709e96edb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:05.609182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9c7f-139f-4886-a235-709e96edb5c4 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:05.610698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 700/1412] 10.222.0.17 () {54 vars in 918 bytes} [Wed Jul 13 09:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:05.617600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0741f-8e7f-4c32-a1d7-041bd4041d8c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:05.617888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0741f-8e7f-4c32-a1d7-041bd4041d8c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:05.618160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db0741f-8e7f-4c32-a1d7-041bd4041d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:05.699650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:05.702608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1db0741f-8e7f-4c32-a1d7-041bd4041d8c None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:05.704316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1db0741f-8e7f-4c32-a1d7-041bd4041d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:05.834915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 713/1413] 10.222.0.17 () {58 vars in 1015 bytes} [Wed Jul 13 09:51:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:08.325757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d61ff-3f2a-4cc2-b936-18f6db137899 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:08.326336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d61ff-3f2a-4cc2-b936-18f6db137899 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:08.326336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d61ff-3f2a-4cc2-b936-18f6db137899 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:08.328313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 701/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:08.334786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525f0f-54ea-4c18-a3ff-815445ce0873 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:08.335216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525f0f-54ea-4c18-a3ff-815445ce0873 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:08.335435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd525f0f-54ea-4c18-a3ff-815445ce0873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:08.411449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bd525f0f-54ea-4c18-a3ff-815445ce0873 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:08.412642 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd525f0f-54ea-4c18-a3ff-815445ce0873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:08.475490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:08.524487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 714/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:08.567715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d61ff-3f2a-4cc2-b936-18f6db137899 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:08.569212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c96d61ff-3f2a-4cc2-b936-18f6db137899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:08.735344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d61ff-3f2a-4cc2-b936-18f6db137899 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:08.822960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:08.865617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:08.866260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:08.866570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:08.866841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:08.868478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:08.963922 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:08.965530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa94922-1556-4b9f-aeea-bb25cc5796a5 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:08.984149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 702/1416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:09.880531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c054-4da7-40be-91c4-bf2d26db9610 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:09.881122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c054-4da7-40be-91c4-bf2d26db9610 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:09.881122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c054-4da7-40be-91c4-bf2d26db9610 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:09.883274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 715/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:09.891198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda07f-cc61-483c-aa06-600da501a3ac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:09.891675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda07f-cc61-483c-aa06-600da501a3ac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:09.891769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eda07f-cc61-483c-aa06-600da501a3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:09.980952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-96eda07f-cc61-483c-aa06-600da501a3ac None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:09.982151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-96eda07f-cc61-483c-aa06-600da501a3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:10.020838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:10.097535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 703/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:10.249246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c054-4da7-40be-91c4-bf2d26db9610 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:10.251048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9944c054-4da7-40be-91c4-bf2d26db9610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:10.423319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c054-4da7-40be-91c4-bf2d26db9610 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:10.465638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:10.545287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19342926-1305-482a-923d-eadb960aed9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:10.546401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342926-1305-482a-923d-eadb960aed9c service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:10.547047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342926-1305-482a-923d-eadb960aed9c service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:10.547557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19342926-1305-482a-923d-eadb960aed9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:10.550911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-19342926-1305-482a-923d-eadb960aed9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:10.647297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342926-1305-482a-923d-eadb960aed9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:10.648916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19342926-1305-482a-923d-eadb960aed9c service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:10.667450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 716/1419] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:11.554217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5383fa-0a50-4012-b65e-0fdeeb3b8224 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:11.554899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5383fa-0a50-4012-b65e-0fdeeb3b8224 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:11.554899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5383fa-0a50-4012-b65e-0fdeeb3b8224 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:11.556236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 704/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:11.562260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a009-21a6-435c-abc4-b026429e3049 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:11.562906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a009-21a6-435c-abc4-b026429e3049 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:11.562906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a009-21a6-435c-abc4-b026429e3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:11.619704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:11.642557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5566a009-21a6-435c-abc4-b026429e3049 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:11.643748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5566a009-21a6-435c-abc4-b026429e3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:11.742437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 717/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:11.894595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5383fa-0a50-4012-b65e-0fdeeb3b8224 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:11.897056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8f5383fa-0a50-4012-b65e-0fdeeb3b8224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:12.058854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5383fa-0a50-4012-b65e-0fdeeb3b8224 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:12.072535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:12.178358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:12.178971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:12.179253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:12.179535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:12.181186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:12.292577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:12.294160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0058718c-7949-4b00-b59f-ce50753e5bd3 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:12.312815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 705/1422] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:13.169334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096c804-9049-4d2d-a6d2-38555bbe0c8d None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:13.169926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096c804-9049-4d2d-a6d2-38555bbe0c8d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:13.169926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096c804-9049-4d2d-a6d2-38555bbe0c8d None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:13.172430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 718/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:13.178533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb2acd-e450-464e-815e-70b9ab103e14 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:13.178979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb2acd-e450-464e-815e-70b9ab103e14 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:13.179151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb2acd-e450-464e-815e-70b9ab103e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:13.201945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:13.265394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-fcdb2acd-e450-464e-815e-70b9ab103e14 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:13.266623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fcdb2acd-e450-464e-815e-70b9ab103e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:13.385133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 706/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:13.532964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096c804-9049-4d2d-a6d2-38555bbe0c8d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:13.534529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a096c804-9049-4d2d-a6d2-38555bbe0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:13.651836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:13.694160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096c804-9049-4d2d-a6d2-38555bbe0c8d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:13.831211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:13.831772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:13.832158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:13.832429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:13.834092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:13.919021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:13.940078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:13.941695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700735e7-3cd2-41de-ac79-d876f79572b0 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:13.960776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 719/1425] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:14.852405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde975-e2fe-4055-8a6f-9fa16a186306 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:14.852958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde975-e2fe-4055-8a6f-9fa16a186306 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:14.852958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde975-e2fe-4055-8a6f-9fa16a186306 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:14.855240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 707/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:14.864236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295aec-e757-4c38-8680-19f72d23bec2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:14.864757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295aec-e757-4c38-8680-19f72d23bec2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:14.864757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e295aec-e757-4c38-8680-19f72d23bec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:14.947303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4e295aec-e757-4c38-8680-19f72d23bec2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:14.948528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4e295aec-e757-4c38-8680-19f72d23bec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:15.067245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 720/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:15.235830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde975-e2fe-4055-8a6f-9fa16a186306 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:15.237513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bbbde975-e2fe-4055-8a6f-9fa16a186306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:15.356805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:15.429978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde975-e2fe-4055-8a6f-9fa16a186306 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:15.584735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:15.585295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:15.585587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:15.585860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:15.587570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:15.643941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:15.689365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:15.691015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea5e372-a3a2-4bed-a5b5-f8044130e87d service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:15.710574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 708/1428] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:16.532006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651dd38-263e-4e0b-997f-59272fed5aac None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:16.532914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651dd38-263e-4e0b-997f-59272fed5aac None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:16.532914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651dd38-263e-4e0b-997f-59272fed5aac None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:16.535144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 721/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:16.541216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d90b4-255f-4452-b26a-868b109bc8f6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:16.541663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d90b4-255f-4452-b26a-868b109bc8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:16.541852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2d90b4-255f-4452-b26a-868b109bc8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:16.650546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cc2d90b4-255f-4452-b26a-868b109bc8f6 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:16.651759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cc2d90b4-255f-4452-b26a-868b109bc8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:16.756177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 709/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:16.909649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651dd38-263e-4e0b-997f-59272fed5aac None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:16.911916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f651dd38-263e-4e0b-997f-59272fed5aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:16.973266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:17.072144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651dd38-263e-4e0b-997f-59272fed5aac None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:17.192764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:17.193349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:17.193625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:17.193892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:17.195571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:17.202956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:17.292074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:17.293691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159915f0-34d9-41c4-ac54-7c93d1f41e85 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:17.313764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 722/1431] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:18.130584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e823-04a1-445f-a361-eddf5aae6e3f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:18.131059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e823-04a1-445f-a361-eddf5aae6e3f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:18.131182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219e823-04a1-445f-a361-eddf5aae6e3f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:18.132551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 710/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:18.138268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbd41c-6a92-409a-a145-db2039022933 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:18.138700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbd41c-6a92-409a-a145-db2039022933 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:18.138870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcbd41c-6a92-409a-a145-db2039022933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:18.215546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9bcbd41c-6a92-409a-a145-db2039022933 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:18.216768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9bcbd41c-6a92-409a-a145-db2039022933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:18.295087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:18.325611 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 723/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:18.476864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e823-04a1-445f-a361-eddf5aae6e3f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:18.479223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9219e823-04a1-445f-a361-eddf5aae6e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:18.505409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:18.666633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219e823-04a1-445f-a361-eddf5aae6e3f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:18.773495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:18.809451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:18.810101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:18.810378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:18.810676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:18.812453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:18.916631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:18.918869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf134ac2-66c6-459b-a2f0-c8aa66be7db1 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:18.950638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 711/1434] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:19.749403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15443c52-62ca-481d-bd3f-075645e41305 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:19.749930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15443c52-62ca-481d-bd3f-075645e41305 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:19.750033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15443c52-62ca-481d-bd3f-075645e41305 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:19.752385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 724/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:19.758770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deaafb-788d-4a05-8869-c2c1a4b0eb78 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:19.759259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deaafb-788d-4a05-8869-c2c1a4b0eb78 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:19.759368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2deaafb-788d-4a05-8869-c2c1a4b0eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:19.841381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a2deaafb-788d-4a05-8869-c2c1a4b0eb78 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:19.842611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a2deaafb-788d-4a05-8869-c2c1a4b0eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:19.896796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:19.957811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 712/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:20.113292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15443c52-62ca-481d-bd3f-075645e41305 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:20.115282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15443c52-62ca-481d-bd3f-075645e41305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:20.292654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15443c52-62ca-481d-bd3f-075645e41305 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:20.359171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:20.420473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:20.421224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:20.421513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:20.421783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:20.423471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:20.643636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:20.645149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2f60-9892-44a7-898b-645952295df8 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:20.664157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 725/1437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:21.469824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04717e72-5db1-416e-a2d5-d5b6b94a631a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:21.470685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04717e72-5db1-416e-a2d5-d5b6b94a631a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:21.470685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04717e72-5db1-416e-a2d5-d5b6b94a631a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:21.472439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 713/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:51:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:21.477687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a430ef-deb5-41d0-8785-97542911467c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:21.478150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a430ef-deb5-41d0-8785-97542911467c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:21.478253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a430ef-deb5-41d0-8785-97542911467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:21.560815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-76a430ef-deb5-41d0-8785-97542911467c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:21.562380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-76a430ef-deb5-41d0-8785-97542911467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:21.564433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:21.673371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 726/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:21.831846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04717e72-5db1-416e-a2d5-d5b6b94a631a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:21.833351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-04717e72-5db1-416e-a2d5-d5b6b94a631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:22.004365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04717e72-5db1-416e-a2d5-d5b6b94a631a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:22.034657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:22.138408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:22.139089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:22.139374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:22.139655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:22.141343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:22.234008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:22.235781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a8b19-0e60-4c51-a385-6b15b6ff5c78 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:22.255764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 714/1440] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:24.209882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d77df5-2866-421a-9c2e-02f78e361f55 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:24.210838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d77df5-2866-421a-9c2e-02f78e361f55 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:24.210975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d77df5-2866-421a-9c2e-02f78e361f55 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:24.213280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 727/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:24.219643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0231-2846-4eea-90de-663d68f1c5f4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:24.220361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0231-2846-4eea-90de-663d68f1c5f4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:24.220540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a0231-2846-4eea-90de-663d68f1c5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:24.267721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:24.295748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1a3a0231-2846-4eea-90de-663d68f1c5f4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:24.296974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1a3a0231-2846-4eea-90de-663d68f1c5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:24.415936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 715/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:24.462732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d77df5-2866-421a-9c2e-02f78e361f55 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:24.464962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d9d77df5-2866-421a-9c2e-02f78e361f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:24.578407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d77df5-2866-421a-9c2e-02f78e361f55 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:24.613314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:24.658959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:24.659521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:24.659805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:24.660088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:24.661731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:24.788531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:24.789998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3bd44-388d-4c5c-bcb9-fabdec81b0ea service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:24.808919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 728/1443] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:51:26.986068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95de743-bc0a-49f1-b981-868997af7ffb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:26.987056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95de743-bc0a-49f1-b981-868997af7ffb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:26.987056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95de743-bc0a-49f1-b981-868997af7ffb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:26.989572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 716/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:26.996192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe0a5f-f14e-492d-905e-b6434c4fb268 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:26.996964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe0a5f-f14e-492d-905e-b6434c4fb268 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:26.997139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe0a5f-f14e-492d-905e-b6434c4fb268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:27.081574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-eafe0a5f-f14e-492d-905e-b6434c4fb268 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:27.082834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eafe0a5f-f14e-492d-905e-b6434c4fb268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:27.096228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:27.185655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 729/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:27.226726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95de743-bc0a-49f1-b981-868997af7ffb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:27.228256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d95de743-bc0a-49f1-b981-868997af7ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:27.339562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95de743-bc0a-49f1-b981-868997af7ffb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:27.352632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:27.420955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:27.422197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:27.422483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:27.422789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:27.424429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:27.544239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:27.545668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e7da-aacf-4cd3-a0ed-d547468e477f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:27.564297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 717/1446] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:29.934460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c4a27-db00-4fe3-b811-fc578e28f9cd None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:29.935103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c4a27-db00-4fe3-b811-fc578e28f9cd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:29.935103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2c4a27-db00-4fe3-b811-fc578e28f9cd None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:29.936403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 730/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:29.943257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481f7b-c5b0-456a-999a-4c7f3e1431af None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:29.944029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481f7b-c5b0-456a-999a-4c7f3e1431af None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:29.944178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e481f7b-c5b0-456a-999a-4c7f3e1431af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:30.001382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:30.025777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6e481f7b-c5b0-456a-999a-4c7f3e1431af None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:30.027025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e481f7b-c5b0-456a-999a-4c7f3e1431af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:30.138610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 718/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:30.180541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c4a27-db00-4fe3-b811-fc578e28f9cd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:30.182108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a2c4a27-db00-4fe3-b811-fc578e28f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:30.306524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2c4a27-db00-4fe3-b811-fc578e28f9cd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:30.352809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:30.389787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:30.390600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:30.390885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:30.391163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:30.392815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:30.510841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:30.512285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03279f9c-1645-4bbb-af04-7e65f17e0d83 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:30.533556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 731/1449] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:32.755717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379257f-5c05-48fb-a8e9-c298981b50eb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:32.756345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379257f-5c05-48fb-a8e9-c298981b50eb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:32.756345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379257f-5c05-48fb-a8e9-c298981b50eb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:32.757646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 719/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:32.764365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c221-6496-41ba-8d83-033b40d0264f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:32.765142 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c221-6496-41ba-8d83-033b40d0264f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:32.765305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c221-6496-41ba-8d83-033b40d0264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:32.841898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b603c221-6496-41ba-8d83-033b40d0264f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:32.843153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b603c221-6496-41ba-8d83-033b40d0264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:32.866327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:32.947600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 732/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:32.988559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379257f-5c05-48fb-a8e9-c298981b50eb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:32.990954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4379257f-5c05-48fb-a8e9-c298981b50eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:33.110724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379257f-5c05-48fb-a8e9-c298981b50eb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:33.133788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:33.205608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:33.206696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:33.207126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:33.207568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:33.210235 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:33.341150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:33.342651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c637517-227b-43d8-923a-136f12539f67 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:33.363620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 720/1452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:35.448145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea3866-924d-4809-9040-59e0ec8f250c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:35.448736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea3866-924d-4809-9040-59e0ec8f250c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:35.448736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea3866-924d-4809-9040-59e0ec8f250c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:35.450138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 733/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:35.457045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de008-5471-44d7-a781-7a5e2bc4555d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:35.457511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de008-5471-44d7-a781-7a5e2bc4555d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:35.457610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102de008-5471-44d7-a781-7a5e2bc4555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:35.533363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:35.536604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-102de008-5471-44d7-a781-7a5e2bc4555d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:35.538321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-102de008-5471-44d7-a781-7a5e2bc4555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:35.649573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 721/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:35.687365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea3866-924d-4809-9040-59e0ec8f250c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:35.688954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-caea3866-924d-4809-9040-59e0ec8f250c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:35.799919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea3866-924d-4809-9040-59e0ec8f250c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:35.856837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:35.884164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:35.884814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:35.885097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:35.885691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:35.887366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:36.016760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:36.018207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad29958-7084-4465-8099-76964c0612f6 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:36.037437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 734/1455] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:38.101154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ca41-6d7e-4167-ae94-c670b61ee230 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:38.102055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ca41-6d7e-4167-ae94-c670b61ee230 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:38.102055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ca41-6d7e-4167-ae94-c670b61ee230 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:38.104317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 722/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:38.111297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f951c-e194-4c29-83fd-0971dc05b0d0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:38.111770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f951c-e194-4c29-83fd-0971dc05b0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:38.111868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f951c-e194-4c29-83fd-0971dc05b0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:38.181291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7f9f951c-e194-4c29-83fd-0971dc05b0d0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:38.182530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7f9f951c-e194-4c29-83fd-0971dc05b0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:38.214281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:38.289944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 735/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:38.331693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ca41-6d7e-4167-ae94-c670b61ee230 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:38.333252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6170ca41-6d7e-4167-ae94-c670b61ee230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:38.454668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ca41-6d7e-4167-ae94-c670b61ee230 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:38.485318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:38.539675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:38.540330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:38.540613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:38.540887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:38.542579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:38.678938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:38.680277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661bb71-1c42-4212-9f08-e0d4acf6b6a4 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:38.699947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 723/1458] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:40.778900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16768dd2-240b-4d08-a508-f92aaeefaad6 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:40.779497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16768dd2-240b-4d08-a508-f92aaeefaad6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:40.779497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16768dd2-240b-4d08-a508-f92aaeefaad6 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:40.781247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 736/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:51:40.786450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c294dd3-0ad7-4647-804f-0eb242985bfb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:40.786912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c294dd3-0ad7-4647-804f-0eb242985bfb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:40.787008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c294dd3-0ad7-4647-804f-0eb242985bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:40.856136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4c294dd3-0ad7-4647-804f-0eb242985bfb None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:40.857314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4c294dd3-0ad7-4647-804f-0eb242985bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:40.866454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:40.960972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 724/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:41.001341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16768dd2-240b-4d08-a508-f92aaeefaad6 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:41.002905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16768dd2-240b-4d08-a508-f92aaeefaad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:41.118940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16768dd2-240b-4d08-a508-f92aaeefaad6 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:41.178755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:41.207010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:41.207669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:41.207951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:41.208223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:41.209870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:41.333859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:41.335389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e94a11e-91d1-494f-96ee-547ddf98e2cd service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:41.353954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 737/1461] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:51:43.451540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f067-45e5-434a-b98f-862e1b236b99 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:43.452413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f067-45e5-434a-b98f-862e1b236b99 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:43.452413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3f067-45e5-434a-b98f-862e1b236b99 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:43.454090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 725/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:43.459622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e66bd2-0a67-41cd-8b7e-16320b0a2ae8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:43.460046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e66bd2-0a67-41cd-8b7e-16320b0a2ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:43.460179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e66bd2-0a67-41cd-8b7e-16320b0a2ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:43.533574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-16e66bd2-0a67-41cd-8b7e-16320b0a2ae8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:43.534827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16e66bd2-0a67-41cd-8b7e-16320b0a2ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:43.574052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:43.636591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 738/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:43.675633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f067-45e5-434a-b98f-862e1b236b99 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:43.678040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ecf3f067-45e5-434a-b98f-862e1b236b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:43.798740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3f067-45e5-434a-b98f-862e1b236b99 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:43.839366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:43.879300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:43.879948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:43.880229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:43.880507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:43.882142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:44.005281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:44.006773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afb060-5d51-4dc2-a15d-73105103c304 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:44.026510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 726/1464] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:46.108801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddd84e-864b-48b5-9f44-0b65ea4e83cc None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:46.109654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddd84e-864b-48b5-9f44-0b65ea4e83cc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:46.109654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ddd84e-864b-48b5-9f44-0b65ea4e83cc None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:46.112224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 739/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:46.120679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761dfb-43f6-4cce-9749-f2c035a13a78 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:46.121413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761dfb-43f6-4cce-9749-f2c035a13a78 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:46.121624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2761dfb-43f6-4cce-9749-f2c035a13a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:46.191827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a2761dfb-43f6-4cce-9749-f2c035a13a78 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:46.193065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a2761dfb-43f6-4cce-9749-f2c035a13a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:46.214227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:46.299479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 727/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:46.339290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddd84e-864b-48b5-9f44-0b65ea4e83cc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:46.341683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e6ddd84e-864b-48b5-9f44-0b65ea4e83cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:46.466376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ddd84e-864b-48b5-9f44-0b65ea4e83cc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:46.546607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:46.554448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:46.555149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:46.555425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:46.555690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:46.557331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:46.686539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:46.687916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd65947d-3a96-4f49-bb17-22e4970f66d9 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:46.707716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 740/1467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:48.807001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050e4c-b1f0-4ebb-b12e-218e85cf2729 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:48.807944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050e4c-b1f0-4ebb-b12e-218e85cf2729 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:48.807944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e050e4c-b1f0-4ebb-b12e-218e85cf2729 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:48.810114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:51:48.819367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395abb1-e52b-48e0-b7a8-e8da7bff03a6 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:48.819810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395abb1-e52b-48e0-b7a8-e8da7bff03a6 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:48.820014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395abb1-e52b-48e0-b7a8-e8da7bff03a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:48.892011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c395abb1-e52b-48e0-b7a8-e8da7bff03a6 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:51:48.893329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c395abb1-e52b-48e0-b7a8-e8da7bff03a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:48.947323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:49.004355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:51:49.045131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050e4c-b1f0-4ebb-b12e-218e85cf2729 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:51:49.046769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e050e4c-b1f0-4ebb-b12e-218e85cf2729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:49.159253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e050e4c-b1f0-4ebb-b12e-218e85cf2729 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:51:49.223996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:49.254087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:51:49.254775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:51:49.255060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:51:49.255337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:51:49.256980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:51:49.377756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:51:49.379252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c7f3a-6753-481c-8a60-11fb5fffcf3d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:51:49.399176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 729/1470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:51:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:51:59.001734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=22 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:51:59.396496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=66 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:09.105563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfab27-95ba-45b7-8f13-0e2aea698149 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:09.106167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfab27-95ba-45b7-8f13-0e2aea698149 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:09.106167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfab27-95ba-45b7-8f13-0e2aea698149 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:09.107548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 742/1471] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:09.114104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9f1a-603f-4c20-899b-962b89e9f31d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:09.114861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9f1a-603f-4c20-899b-962b89e9f31d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:09.115053 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a9f1a-603f-4c20-899b-962b89e9f31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:09.194050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-440a9f1a-603f-4c20-899b-962b89e9f31d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:09.195336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-440a9f1a-603f-4c20-899b-962b89e9f31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:09.301460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 730/1472] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:09.389761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78de430-ce74-4c4d-a27c-9f7e1e47b576 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:09.390052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78de430-ce74-4c4d-a27c-9f7e1e47b576 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:09.390323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78de430-ce74-4c4d-a27c-9f7e1e47b576 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:09.391744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 743/1473] 10.222.0.17 () {54 vars in 962 bytes} [Wed Jul 13 09:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:09.399565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9384-255f-4775-b229-ee8836a160f1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:09.399879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9384-255f-4775-b229-ee8836a160f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:09.400229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf9384-255f-4775-b229-ee8836a160f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:09.484108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0bdf9384-255f-4775-b229-ee8836a160f1 None None] MFA Rules not processed for user `2947dfd2c2b14daf9c16e534b0139da5`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:09.485321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bdf9384-255f-4775-b229-ee8836a160f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:09.510827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:09.575584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 731/1474] 10.222.0.17 () {58 vars in 1059 bytes} [Wed Jul 13 09:52:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:09.583337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78de430-ce74-4c4d-a27c-9f7e1e47b576 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:09.584852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a78de430-ce74-4c4d-a27c-9f7e1e47b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:09.700351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78de430-ce74-4c4d-a27c-9f7e1e47b576 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:09.781288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:09.781940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:09.782223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:09.782519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:09.784340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:09.842443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:09.902308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:09.903776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ddfaa-4b46-4d6e-84f2-094988f72ae5 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:09.924821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 744/1475] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:52:12.024530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd57f4-0078-4b77-bb1a-6b4847043517 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:12.025130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd57f4-0078-4b77-bb1a-6b4847043517 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:12.025130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd57f4-0078-4b77-bb1a-6b4847043517 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:12.027309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 732/1476] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:12.036490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa23a-b2d8-460b-ab41-fac1b39ab3ec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:12.036930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa23a-b2d8-460b-ab41-fac1b39ab3ec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:12.037069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25aa23a-b2d8-460b-ab41-fac1b39ab3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:12.108540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a25aa23a-b2d8-460b-ab41-fac1b39ab3ec None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:12.109730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a25aa23a-b2d8-460b-ab41-fac1b39ab3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:12.214855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 745/1477] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:12.238817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd57f4-0078-4b77-bb1a-6b4847043517 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:12.240369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d5bd57f4-0078-4b77-bb1a-6b4847043517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:12.378336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd57f4-0078-4b77-bb1a-6b4847043517 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:12.431323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:12.480086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:12.480749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:12.481031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:12.481309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:12.482038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:12.483841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:52:12.483841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:52:12.483841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:52:12.485026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77556282-4514-4808-95ce-b54ebc0c90c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:12.505510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 733/1478] 10.222.0.17 () {56 vars in 1108 bytes} [Wed Jul 13 09:52:12 2022] GET /identity/v3/projects => generated 2553 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:52:14.556511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492bde1-dcfe-4ddc-961f-04ec74d8b2a8 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:14.557084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492bde1-dcfe-4ddc-961f-04ec74d8b2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:14.557084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492bde1-dcfe-4ddc-961f-04ec74d8b2a8 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:14.558446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 746/1479] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:14.565156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4373586-2bb6-4aad-9ae5-5469c73afd49 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:14.565647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4373586-2bb6-4aad-9ae5-5469c73afd49 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:14.565647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4373586-2bb6-4aad-9ae5-5469c73afd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:14.632118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d4373586-2bb6-4aad-9ae5-5469c73afd49 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:14.633324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d4373586-2bb6-4aad-9ae5-5469c73afd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:14.739275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 734/1480] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:14.788634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492bde1-dcfe-4ddc-961f-04ec74d8b2a8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:14.790541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5492bde1-dcfe-4ddc-961f-04ec74d8b2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:14.803609 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:14.947541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492bde1-dcfe-4ddc-961f-04ec74d8b2a8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:15.032714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:15.067666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:15.068316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:15.068592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:15.068863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:15.070564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:15.165937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:15.167549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76cf0cc-534f-4b51-bf73-46583c2c48f2 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:15.186602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 747/1481] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:52:17.543690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18d94-ff6f-40d9-9ee7-245c1fc82efc None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:17.544295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18d94-ff6f-40d9-9ee7-245c1fc82efc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:17.544295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff18d94-ff6f-40d9-9ee7-245c1fc82efc None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:17.545651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 735/1482] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:17.554348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24633-2443-43a4-b780-408d5ed1f33f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:17.555110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24633-2443-43a4-b780-408d5ed1f33f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:17.555217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24633-2443-43a4-b780-408d5ed1f33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:17.626118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7cd24633-2443-43a4-b780-408d5ed1f33f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:17.627448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7cd24633-2443-43a4-b780-408d5ed1f33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:17.675936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:17.729900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 748/1483] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:17.770986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18d94-ff6f-40d9-9ee7-245c1fc82efc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:17.773434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ff18d94-ff6f-40d9-9ee7-245c1fc82efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:17.803607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:17.893287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff18d94-ff6f-40d9-9ee7-245c1fc82efc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:17.974164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:17.974865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:17.975140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:17.975408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:17.977050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:18.060194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:18.096868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:18.098307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b6b3c-4df0-410c-89d4-227de20cb24c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:18.119169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 736/1484] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:52:20.222356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f646-d452-44ca-bd62-21d07aaad0a7 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:20.223025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f646-d452-44ca-bd62-21d07aaad0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:20.223025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f646-d452-44ca-bd62-21d07aaad0a7 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:20.224338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 749/1485] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:20.230950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948801fa-0dfc-4760-ba78-7a1dfd215075 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:20.231421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948801fa-0dfc-4760-ba78-7a1dfd215075 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:20.231530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948801fa-0dfc-4760-ba78-7a1dfd215075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:20.429184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-948801fa-0dfc-4760-ba78-7a1dfd215075 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:20.430369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-948801fa-0dfc-4760-ba78-7a1dfd215075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:20.535582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 737/1486] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:20.573704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f646-d452-44ca-bd62-21d07aaad0a7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:20.575274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c89f646-d452-44ca-bd62-21d07aaad0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:20.689666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f646-d452-44ca-bd62-21d07aaad0a7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:20.767190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:20.769308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:20.770015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:20.770302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:20.770620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:20.772844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:20.895094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:20.896589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4f81c-d1fa-4705-8a52-4c5f6acb17bb service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:20.916642 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 750/1487] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:52:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:52:23.096412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ea78-eea6-444f-8348-245cd6b1e61e None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:23.097298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ea78-eea6-444f-8348-245cd6b1e61e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:23.097477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a0ea78-eea6-444f-8348-245cd6b1e61e None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:23.099724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 738/1488] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:23.108452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158edec-5718-48ee-aef4-6e0756786d46 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:23.109145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158edec-5718-48ee-aef4-6e0756786d46 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:23.109369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4158edec-5718-48ee-aef4-6e0756786d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:23.185702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4158edec-5718-48ee-aef4-6e0756786d46 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:23.187616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4158edec-5718-48ee-aef4-6e0756786d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:23.250931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:23.297117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 751/1489] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:23.341788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ea78-eea6-444f-8348-245cd6b1e61e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:23.344222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-90a0ea78-eea6-444f-8348-245cd6b1e61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:23.390518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:23.475796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a0ea78-eea6-444f-8348-245cd6b1e61e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:23.559627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:23.560278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:23.560575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:23.560824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:23.562461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:23.649583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:23.681227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:23.682670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f6590-c74b-4d23-b1e3-2435539b80a7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:23.700827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 739/1490] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:52:25.897095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9707-677d-4013-9912-c89a123a7074 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:25.897695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9707-677d-4013-9912-c89a123a7074 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:25.897695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f9707-677d-4013-9912-c89a123a7074 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:25.899062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 752/1491] 10.222.0.17 () {54 vars in 926 bytes} [Wed Jul 13 09:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:52:25.905461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72decd6a-be7a-4475-ad4d-fb8a2220fc1b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:25.906219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72decd6a-be7a-4475-ad4d-fb8a2220fc1b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:25.906352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72decd6a-be7a-4475-ad4d-fb8a2220fc1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:25.980195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-72decd6a-be7a-4475-ad4d-fb8a2220fc1b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:52:25.981416 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-72decd6a-be7a-4475-ad4d-fb8a2220fc1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:26.091966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 740/1492] 10.222.0.17 () {58 vars in 1023 bytes} [Wed Jul 13 09:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:52:26.131232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9707-677d-4013-9912-c89a123a7074 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:52:26.132807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d63f9707-677d-4013-9912-c89a123a7074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:26.248273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f9707-677d-4013-9912-c89a123a7074 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:52:26.325192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:52:26.325831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:52:26.326119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:52:26.326387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:52:26.328061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:52:26.338105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:26.444437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:52:26.445873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd534a04-ca8c-48c7-9fa8-445d041bf39a service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:52:26.464300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 753/1493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:52:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:52:36.089755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=82 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:52:36.461887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=50 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:53.056522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:53.057484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:53.057484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:53.138297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:53:53.139855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:53.251941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 741/1494] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:53:53.260288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:53.260810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:53.260810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:53.344960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:53:53.346078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:53.446457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 754/1495] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:53:53.451481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:53.452702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:53.464433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d7a37-a864-4d38-be07-c3a4c744673e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:53.530556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:53.564767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:53.570221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:53.570221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:53.570221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:53.570221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:53:53.570221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:53.570760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:53.570760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:53:53.570760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:53:53.570760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:53.581038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 742/1496] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:53:53.589667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:53.599670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f82e807-d87c-4996-bd4a-bc4dd10710ce None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:53.662315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:53.696897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:53.697548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:53.697833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:53.698107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:53.698830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:53.700578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:53.700578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:53:53.700578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:53:53.701765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:53.761669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 755/1497] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:53:53 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:53:53.766291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:53.767869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:53.803339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda71742-32cf-4a93-bb59-54abe3c92210 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:53.903111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:53.903714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:53.903994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:53.904264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:53.904947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:53.905966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:53.905966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:53:53.905966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:53:53.907333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:53.952241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 743/1498] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:53:53 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:53:53.957485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:53.959057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:54.024625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41368d19-c74c-4ce0-9e5a-d1bdff76ad7b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:54.110342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:54.122162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:54.122865 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:54.123144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:54.123414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:54.124140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:54.125165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:54.125165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:53:54.125165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:53:54.126041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:54.140119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 756/1499] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:53:54.144576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:54.146086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:54.157824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a4f83-6850-4d65-89c9-f7476921c250 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:54.185290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:54.260914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:54.261572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:54.261849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:54.262114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:54.262862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:54.264182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:54.264182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:53:54.264182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:53:54.265061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b182-a1f0-43b9-8cc1-4aa29ff4ffde admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:54.278084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 744/1500] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:53:54.282787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:54.284486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:54.319874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dafc18-f14c-4c1a-9a9a-ee12f7bb9628 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:54.425796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:54.426646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:54.426921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:54.427159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] PATH_INFO: `/v3/projects/54d8eea5873b430cbb3deaac50513885/users/021fa4a25bce4c428810dd12a2d2300c/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:54.451966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54d8eea5873b430cbb3deaac50513885, user_id=021fa4a25bce4c428810dd12a2d2300c, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:54.452992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:54.452992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:53:54.452992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:53:54.455387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5dfb25-c5d6-4f02-b206-a2f9195e0c01 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:54.485337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 757/1501] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:53:54 2022] PUT /identity/v3/projects/54d8eea5873b430cbb3deaac50513885/users/021fa4a25bce4c428810dd12a2d2300c/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:53:54.497728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f28e-4866-4a01-ba5b-58690800c6b3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:54.498017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f28e-4866-4a01-ba5b-58690800c6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:54.498297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345f28e-4866-4a01-ba5b-58690800c6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:54.555519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b345f28e-4866-4a01-ba5b-58690800c6b3 None None] MFA Rules not processed for user `021fa4a25bce4c428810dd12a2d2300c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:53:54.556721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b345f28e-4866-4a01-ba5b-58690800c6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:54.653620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 745/1502] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:53:54.667320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef2a4-f637-46e6-9a0d-5945f71a1b1c None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:54.667635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef2a4-f637-46e6-9a0d-5945f71a1b1c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:54.667911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ef2a4-f637-46e6-9a0d-5945f71a1b1c None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:54.669312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 758/1503] 10.222.0.17 () {54 vars in 963 bytes} [Wed Jul 13 09:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:53:54.674558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69877e45-b0db-43b2-b60c-3bf56d7aef43 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:54.674883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69877e45-b0db-43b2-b60c-3bf56d7aef43 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:54.675158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69877e45-b0db-43b2-b60c-3bf56d7aef43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:54.706138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:54.752775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-69877e45-b0db-43b2-b60c-3bf56d7aef43 None None] MFA Rules not processed for user `50bda80f77ff46908f3011622beb3e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:53:54.753966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-69877e45-b0db-43b2-b60c-3bf56d7aef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:54.839039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 746/1504] 10.222.0.17 () {58 vars in 1060 bytes} [Wed Jul 13 09:53:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:53:54.847386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef2a4-f637-46e6-9a0d-5945f71a1b1c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:54.848924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d01ef2a4-f637-46e6-9a0d-5945f71a1b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:54.909684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:54.967698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ef2a4-f637-46e6-9a0d-5945f71a1b1c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:55.045573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:55.046214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:55.046511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:55.046756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:55.048421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:55.159772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:55.161269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:55.164885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:55.180037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 759/1505] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:53:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:53:55.221914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ab22-3ab8-4cee-9b97-5f9b0002efaa None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:55.222374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ab22-3ab8-4cee-9b97-5f9b0002efaa None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:55.222496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36ab22-3ab8-4cee-9b97-5f9b0002efaa None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:55.223759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 747/1506] 10.222.0.17 () {52 vars in 829 bytes} [Wed Jul 13 09:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:53:55.227660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:55.228859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:55.349755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf97e6a6-7858-4397-b4ba-e367434e0b5f service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:55.459168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:55.460024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:55.460340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:55.460614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] PATH_INFO: `/v3/users/021fa4a25bce4c428810dd12a2d2300c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:55.474745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=021fa4a25bce4c428810dd12a2d2300c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:55.475710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:55.475710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:53:55.475710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:53:55.476918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:55.488029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:55.545213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '021fa4a25bce4c428810dd12a2d2300c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:55.572197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '021fa4a25bce4c428810dd12a2d2300c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:55.585127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '021fa4a25bce4c428810dd12a2d2300c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:55.597917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '021fa4a25bce4c428810dd12a2d2300c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:55.598451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '021fa4a25bce4c428810dd12a2d2300c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:55.604678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 760/1507] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:53:55 2022] DELETE /identity/v3/users/021fa4a25bce4c428810dd12a2d2300c => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:53:55.609465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:55.609750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:55.610046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:55.665727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:53:55.666976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:55.744534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:55.757931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 748/1508] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:53:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:53:55.768435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:55.769661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:55.883711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42e648-8032-42ec-aedd-36c57b3a2c9d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:55.944299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:53:55.967594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:55.968243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:55.968526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:55.968798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:55.970514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:56.092999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:56.094357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e14363-0d0a-4f7f-855c-7950c85d2f10 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:56.114138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 761/1509] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:53:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:53:56.476092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:53:56.477365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:53:56.490868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f5946a-4c47-4e95-a54c-3696aad0acfb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:53:56.597085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:53:56.597958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:53:56.598212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:53:56.598522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] PATH_INFO: `/v3/projects/54d8eea5873b430cbb3deaac50513885` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:53:56.609393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54d8eea5873b430cbb3deaac50513885)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:53:56.610459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:53:56.610459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:53:56.610459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:53:56.612462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:53:56.676870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54d8eea5873b430cbb3deaac50513885', 'request_id': 'req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:56.693968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54d8eea5873b430cbb3deaac50513885', 'request_id': 'req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:56.704080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54d8eea5873b430cbb3deaac50513885', 'request_id': 'req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:56.731275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] The token cache is being invalidate because project 54d8eea5873b430cbb3deaac50513885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:53:56.731549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:56.731990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3bd1190-34bb-49cd-949c-b89b2f43a7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:53:56.733446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 749/1510] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:53:56 2022] DELETE /identity/v3/projects/54d8eea5873b430cbb3deaac50513885 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:54:06.111575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=62 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:54:06.728488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:55:32.796217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39b70e-a74e-44fb-bd1b-3bec25b18b99 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:32.797146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39b70e-a74e-44fb-bd1b-3bec25b18b99 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:32.797146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39b70e-a74e-44fb-bd1b-3bec25b18b99 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:32.799343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:55:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:32.807625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60d132-f50e-4b48-9636-14e5904d9a44 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:32.808406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60d132-f50e-4b48-9636-14e5904d9a44 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:32.808592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad60d132-f50e-4b48-9636-14e5904d9a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:32.905476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ad60d132-f50e-4b48-9636-14e5904d9a44 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:32.906730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ad60d132-f50e-4b48-9636-14e5904d9a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:33.028119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:33.180225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39b70e-a74e-44fb-bd1b-3bec25b18b99 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:33.183827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ff39b70e-a74e-44fb-bd1b-3bec25b18b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:33.326294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39b70e-a74e-44fb-bd1b-3bec25b18b99 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:33.333318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58fc29-661e-4561-8315-16ffa0371257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:33.333960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58fc29-661e-4561-8315-16ffa0371257 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:33.334238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58fc29-661e-4561-8315-16ffa0371257 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:33.334511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58fc29-661e-4561-8315-16ffa0371257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:33.343702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58fc29-661e-4561-8315-16ffa0371257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:33.345284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58fc29-661e-4561-8315-16ffa0371257 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:33.354915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 763/1513] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:34.187658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10ca3-69dc-401f-a6ea-3e78b5500c7d None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:34.188247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10ca3-69dc-401f-a6ea-3e78b5500c7d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:34.188247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae10ca3-69dc-401f-a6ea-3e78b5500c7d None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:34.190457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 751/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:55:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:34.196498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd221cf-112a-4c07-937e-e850f19bed03 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:34.196942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd221cf-112a-4c07-937e-e850f19bed03 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:34.197076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd221cf-112a-4c07-937e-e850f19bed03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:34.223712 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2dd221cf-112a-4c07-937e-e850f19bed03 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:34.224912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2dd221cf-112a-4c07-937e-e850f19bed03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:34.234601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 764/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:34.391396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae10ca3-69dc-401f-a6ea-3e78b5500c7d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:34.406997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae10ca3-69dc-401f-a6ea-3e78b5500c7d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:34.413679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3be7bd-0db9-42e4-b115-113c69b80b85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:34.414325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be7bd-0db9-42e4-b115-113c69b80b85 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:34.414657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be7bd-0db9-42e4-b115-113c69b80b85 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:34.414932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3be7bd-0db9-42e4-b115-113c69b80b85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:34.423687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3be7bd-0db9-42e4-b115-113c69b80b85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:34.425272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3be7bd-0db9-42e4-b115-113c69b80b85 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:34.435421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 752/1516] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:34.990777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a486c-e256-4f45-b3e4-c30cb9782e82 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:34.991017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a486c-e256-4f45-b3e4-c30cb9782e82 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:34.991320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a486c-e256-4f45-b3e4-c30cb9782e82 None None] PATH_INFO: `/v3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:34.992678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 765/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Jul 13 09:55:34 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:55:35.000659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5721d2-7908-4ebc-9544-e67c710603ea None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:35.000970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5721d2-7908-4ebc-9544-e67c710603ea None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:35.001248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5721d2-7908-4ebc-9544-e67c710603ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:35.062768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9e5721d2-7908-4ebc-9544-e67c710603ea None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:35.064004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9e5721d2-7908-4ebc-9544-e67c710603ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:35.082130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:55:35.144237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 753/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Jul 13 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:39.004082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0061119-6eb4-475e-ae01-a5be2adc1163 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:39.004627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0061119-6eb4-475e-ae01-a5be2adc1163 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:39.004627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0061119-6eb4-475e-ae01-a5be2adc1163 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:39.005942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 766/1519] 10.222.0.17 () {54 vars in 960 bytes} [Wed Jul 13 09:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:39.012115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa57e6-ffff-4905-80f2-17c086ec49fe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:39.012883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa57e6-ffff-4905-80f2-17c086ec49fe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:39.013521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa57e6-ffff-4905-80f2-17c086ec49fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:39.033472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-40aa57e6-ffff-4905-80f2-17c086ec49fe None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:39.034702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-40aa57e6-ffff-4905-80f2-17c086ec49fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:39.045199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 754/1520] 10.222.0.17 () {58 vars in 1057 bytes} [Wed Jul 13 09:55:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:39.056078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0061119-6eb4-475e-ae01-a5be2adc1163 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:39.071096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0061119-6eb4-475e-ae01-a5be2adc1163 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:39.077032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d30c83d-1236-4c2d-ba22-753b116ea78b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:39.077655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c83d-1236-4c2d-ba22-753b116ea78b service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:39.077934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c83d-1236-4c2d-ba22-753b116ea78b service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:39.078206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30c83d-1236-4c2d-ba22-753b116ea78b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:39.087232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c83d-1236-4c2d-ba22-753b116ea78b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:39.088819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d30c83d-1236-4c2d-ba22-753b116ea78b service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:39.098614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 767/1521] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:45.656158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027b83-a6be-4d3c-be0a-681e0321a78f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:45.656716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027b83-a6be-4d3c-be0a-681e0321a78f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:45.656716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84027b83-a6be-4d3c-be0a-681e0321a78f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:45.658035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:55:45.664296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d763d-b97d-461a-835a-daedf816cc92 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:45.665001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d763d-b97d-461a-835a-daedf816cc92 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:45.665177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d763d-b97d-461a-835a-daedf816cc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:45.690011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-021d763d-b97d-461a-835a-daedf816cc92 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:45.691849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-021d763d-b97d-461a-835a-daedf816cc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:45.704328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:45.858933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027b83-a6be-4d3c-be0a-681e0321a78f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:45.879708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84027b83-a6be-4d3c-be0a-681e0321a78f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:45.888955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a843276-9683-491d-990c-4a325d5d6dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:45.890115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a843276-9683-491d-990c-4a325d5d6dfe service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:45.890399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a843276-9683-491d-990c-4a325d5d6dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:45.890705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a843276-9683-491d-990c-4a325d5d6dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:45.899371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a843276-9683-491d-990c-4a325d5d6dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:45.900957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a843276-9683-491d-990c-4a325d5d6dfe service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:45.911056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 756/1524] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:46.727373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cacab-f324-4ecf-a695-8a4f7729bd8b None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:46.727979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cacab-f324-4ecf-a695-8a4f7729bd8b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:46.727979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cacab-f324-4ecf-a695-8a4f7729bd8b None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:46.729320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 13 09:55:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:46.735529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa168b-64d6-4dd0-a301-7d83ff6e421d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:46.736281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa168b-64d6-4dd0-a301-7d83ff6e421d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:46.736455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfa168b-64d6-4dd0-a301-7d83ff6e421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:46.766156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2dfa168b-64d6-4dd0-a301-7d83ff6e421d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:46.767395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2dfa168b-64d6-4dd0-a301-7d83ff6e421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:46.776215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 13 09:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:46.934481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cacab-f324-4ecf-a695-8a4f7729bd8b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:46.950941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cacab-f324-4ecf-a695-8a4f7729bd8b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:46.958240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae0647-b6c9-446a-99f1-f214762fb086 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:46.958941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae0647-b6c9-446a-99f1-f214762fb086 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:46.959222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae0647-b6c9-446a-99f1-f214762fb086 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:46.959487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae0647-b6c9-446a-99f1-f214762fb086 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:46.969104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae0647-b6c9-446a-99f1-f214762fb086 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:46.970749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae0647-b6c9-446a-99f1-f214762fb086 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:46.980604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 770/1527] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:50.831429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8fa8-7ff6-4952-9a3a-4e3ad2d1a48f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:50.832123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8fa8-7ff6-4952-9a3a-4e3ad2d1a48f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:50.832123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d8fa8-7ff6-4952-9a3a-4e3ad2d1a48f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:50.833391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:50.840050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03734095-b336-46f3-9424-0d08b1506700 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:50.840760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03734095-b336-46f3-9424-0d08b1506700 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:50.840878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03734095-b336-46f3-9424-0d08b1506700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:50.862326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-03734095-b336-46f3-9424-0d08b1506700 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:50.863553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-03734095-b336-46f3-9424-0d08b1506700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:50.873535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:50.951703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8fa8-7ff6-4952-9a3a-4e3ad2d1a48f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:50.953985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-562d8fa8-7ff6-4952-9a3a-4e3ad2d1a48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:51.038021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d8fa8-7ff6-4952-9a3a-4e3ad2d1a48f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:51.042404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f35b2-a58e-45ad-983a-ae0015bb4abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:51.043062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f35b2-a58e-45ad-983a-ae0015bb4abf service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:51.043342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f35b2-a58e-45ad-983a-ae0015bb4abf service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:51.043612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f35b2-a58e-45ad-983a-ae0015bb4abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:51.053411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f35b2-a58e-45ad-983a-ae0015bb4abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:51.054881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9f35b2-a58e-45ad-983a-ae0015bb4abf service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:51.064785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 759/1530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:53.073940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43c1f-2e5e-487c-b078-8e7eb9fb94da None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:53.074570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43c1f-2e5e-487c-b078-8e7eb9fb94da None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:53.074570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf43c1f-2e5e-487c-b078-8e7eb9fb94da None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:53.075905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:53.082386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6993e-4788-439d-818a-888a28f83107 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:53.082855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6993e-4788-439d-818a-888a28f83107 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:53.082971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6993e-4788-439d-818a-888a28f83107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:53.108754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dde6993e-4788-439d-818a-888a28f83107 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:53.110769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dde6993e-4788-439d-818a-888a28f83107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:53.124121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:53.165060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43c1f-2e5e-487c-b078-8e7eb9fb94da None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:53.168369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-adf43c1f-2e5e-487c-b078-8e7eb9fb94da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:53.184217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf43c1f-2e5e-487c-b078-8e7eb9fb94da None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:53.189076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9e60a-d8bb-4b9f-924d-44c585c48d83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:53.189719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9e60a-d8bb-4b9f-924d-44c585c48d83 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:53.190030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9e60a-d8bb-4b9f-924d-44c585c48d83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:53.190298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9e60a-d8bb-4b9f-924d-44c585c48d83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:53.200102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9e60a-d8bb-4b9f-924d-44c585c48d83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:53.201617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9e60a-d8bb-4b9f-924d-44c585c48d83 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:53.211274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 773/1533] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:56.774904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1c61-fa6c-4afd-ad32-2a5ac50958bb None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:56.775754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1c61-fa6c-4afd-ad32-2a5ac50958bb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:56.775754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b1c61-fa6c-4afd-ad32-2a5ac50958bb None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:56.778078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:56.783416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2697ff-f00b-448e-a42b-bfcb6d7a4900 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:56.783867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2697ff-f00b-448e-a42b-bfcb6d7a4900 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:56.783970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2697ff-f00b-448e-a42b-bfcb6d7a4900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:56.790531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=81 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:55:56.803336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4e2697ff-f00b-448e-a42b-bfcb6d7a4900 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:56.804505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4e2697ff-f00b-448e-a42b-bfcb6d7a4900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:56.813604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:57.113513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b1c61-fa6c-4afd-ad32-2a5ac50958bb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:57.115903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5b4b1c61-fa6c-4afd-ad32-2a5ac50958bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:57.199413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:55:57.214658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b1c61-fa6c-4afd-ad32-2a5ac50958bb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:57.219296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d2249f-3d3d-40cc-a020-a4949f81453e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:57.219948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2249f-3d3d-40cc-a020-a4949f81453e service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:57.220231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2249f-3d3d-40cc-a020-a4949f81453e service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:57.220510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d2249f-3d3d-40cc-a020-a4949f81453e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:57.230075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2249f-3d3d-40cc-a020-a4949f81453e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:57.231562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d2249f-3d3d-40cc-a020-a4949f81453e service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:57.241756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 762/1536] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:55:59.261294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e668e27-5c26-4070-9736-bba2c7d4bb20 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:59.261956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e668e27-5c26-4070-9736-bba2c7d4bb20 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:59.261956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e668e27-5c26-4070-9736-bba2c7d4bb20 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:59.263328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 13 09:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:55:59.270375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7859a0-81cd-424b-8d32-85973325b49d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:59.271191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7859a0-81cd-424b-8d32-85973325b49d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:59.271337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7859a0-81cd-424b-8d32-85973325b49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:59.298836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-df7859a0-81cd-424b-8d32-85973325b49d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:55:59.300083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-df7859a0-81cd-424b-8d32-85973325b49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:59.308650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 13 09:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:55:59.608422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e668e27-5c26-4070-9736-bba2c7d4bb20 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:55:59.611699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3e668e27-5c26-4070-9736-bba2c7d4bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:55:59.631135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e668e27-5c26-4070-9736-bba2c7d4bb20 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:55:59.635248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30ee5-a36e-44a5-afdc-ae15e4b01e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:55:59.635908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30ee5-a36e-44a5-afdc-ae15e4b01e66 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:55:59.636190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30ee5-a36e-44a5-afdc-ae15e4b01e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:55:59.636474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30ee5-a36e-44a5-afdc-ae15e4b01e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:55:59.646996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c30ee5-a36e-44a5-afdc-ae15e4b01e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:55:59.648428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c30ee5-a36e-44a5-afdc-ae15e4b01e66 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:55:59.658115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 776/1539] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:56:09.292965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=11 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:56:09.654255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:27.620866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:27.622767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:27.622767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:27.651678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:27.652901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:27.661632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 764/1540] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:27.671108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:27.672275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:27.672768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:27.702583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:27.704334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:27.718905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 777/1541] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:27.724386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:27.740444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f01e9-1cd8-4995-850b-3a26d76491a8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:27.752182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:27.752884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:27.753167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:27.753443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:27.754185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:27.754522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:27.756345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:27.778328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 765/1542] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:27.786730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:27.800432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc08937-3346-4250-80d6-cc6542b8217c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:27.807039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:27.808019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:27.808526 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:27.809025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:27.809942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:27.812127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:27.870764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 778/1543] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:27 2022] POST /identity/v3/projects => generated 405 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:27.875504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:27.892436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ff9b7-8c2b-44f9-b920-6dde1b587ee5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:27.988692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:27.989377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:27.989662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:27.989940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:27.990689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:27.992919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.028247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 766/1544] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:27 2022] POST /identity/v3/users => generated 303 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:28.039387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.062796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff196bd-46ed-43a3-bf00-40bae1bcf911 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.076422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.077514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.078029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.078623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.079593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.081579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.096090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 779/1545] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:28.100545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.116869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcbc3b-ad36-40f1-a171-c8d7c7c7e6d8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.123999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000a68-d21a-4b9a-a86f-f60433b6f148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.124682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000a68-d21a-4b9a-a86f-f60433b6f148 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.124971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000a68-d21a-4b9a-a86f-f60433b6f148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.125250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000a68-d21a-4b9a-a86f-f60433b6f148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.126045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7000a68-d21a-4b9a-a86f-f60433b6f148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.127618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7000a68-d21a-4b9a-a86f-f60433b6f148 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.143096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 767/1546] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:28.147461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.168139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047239-b73d-4396-b2af-80ab5c8b555f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.175586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d1b39-fabf-41a3-9464-bce9e5b62c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.176791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1b39-fabf-41a3-9464-bce9e5b62c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.177281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1b39-fabf-41a3-9464-bce9e5b62c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.177807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d1b39-fabf-41a3-9464-bce9e5b62c16 admin admin] PATH_INFO: `/v3/projects/8694ed2828fc49cba4e17907cd4ba298/users/3469207da54047d8a57e1a1fd82d70eb/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.206842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1b39-fabf-41a3-9464-bce9e5b62c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8694ed2828fc49cba4e17907cd4ba298, user_id=3469207da54047d8a57e1a1fd82d70eb, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.210113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d1b39-fabf-41a3-9464-bce9e5b62c16 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.241271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 780/1547] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:28 2022] PUT /identity/v3/projects/8694ed2828fc49cba4e17907cd4ba298/users/3469207da54047d8a57e1a1fd82d70eb/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:28.262361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625028d-9f29-4460-b234-3e5fa3d99353 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.262712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625028d-9f29-4460-b234-3e5fa3d99353 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.262819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6625028d-9f29-4460-b234-3e5fa3d99353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.268926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf49ae-a782-400f-b985-c4a380e39d99 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.269557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf49ae-a782-400f-b985-c4a380e39d99 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.270049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf49ae-a782-400f-b985-c4a380e39d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.308487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6625028d-9f29-4460-b234-3e5fa3d99353 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.311417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6625028d-9f29-4460-b234-3e5fa3d99353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.332196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6eaf49ae-a782-400f-b985-c4a380e39d99 None None] MFA Rules not processed for user `3469207da54047d8a57e1a1fd82d70eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.333425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6eaf49ae-a782-400f-b985-c4a380e39d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.437786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 768/1548] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.439959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ef3f-fb89-490f-b6d4-f7328a773128 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.440675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ef3f-fb89-490f-b6d4-f7328a773128 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.441174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89ef3f-fb89-490f-b6d4-f7328a773128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.456139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 781/1549] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.457535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f8b80-f62f-4908-adaf-660e82b01b34 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.457988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f8b80-f62f-4908-adaf-660e82b01b34 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.458271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f8b80-f62f-4908-adaf-660e82b01b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.466082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8d89ef3f-fb89-490f-b6d4-f7328a773128 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.467316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d89ef3f-fb89-490f-b6d4-f7328a773128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.475436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 769/1550] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.476650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2da21e-97b1-4886-83c1-5cbcf7638281 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.476934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2da21e-97b1-4886-83c1-5cbcf7638281 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.477211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2da21e-97b1-4886-83c1-5cbcf7638281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.478298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-541f8b80-f62f-4908-adaf-660e82b01b34 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.479540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-541f8b80-f62f-4908-adaf-660e82b01b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.494811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 782/1551] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.494811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf900ba-603b-4328-993a-2aa77bb88ffe None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.494811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf900ba-603b-4328-993a-2aa77bb88ffe None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.494811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf900ba-603b-4328-993a-2aa77bb88ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.499730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7b2da21e-97b1-4886-83c1-5cbcf7638281 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.500948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7b2da21e-97b1-4886-83c1-5cbcf7638281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.513653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 770/1552] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.515907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.516226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.516507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.516881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4bf900ba-603b-4328-993a-2aa77bb88ffe None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.518101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4bf900ba-603b-4328-993a-2aa77bb88ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.526319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 783/1553] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.527946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde150e6-1dc3-4fb9-a66f-dcd6a953977d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.528418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde150e6-1dc3-4fb9-a66f-dcd6a953977d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.528961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde150e6-1dc3-4fb9-a66f-dcd6a953977d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.534893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.536080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.544217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 771/1554] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.544895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.550126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-cde150e6-1dc3-4fb9-a66f-dcd6a953977d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.551351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cde150e6-1dc3-4fb9-a66f-dcd6a953977d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.554972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f92cfc0-a4f1-42cc-853f-2a85772ccbf7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.559228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 784/1555] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.559561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.560212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.560451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae611dd-4ea8-4fbc-8e31-a664956bbe04 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.560559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.560762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.560874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae611dd-4ea8-4fbc-8e31-a664956bbe04 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.561036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae611dd-4ea8-4fbc-8e31-a664956bbe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.561463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.562495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:57:28.562495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:57:28.562495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:57:28.563919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8178167-b1c5-4f80-a146-82dc212483a8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.579019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9ae611dd-4ea8-4fbc-8e31-a664956bbe04 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.580285 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9ae611dd-4ea8-4fbc-8e31-a664956bbe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.589350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 785/1556] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.590640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bf220-1cd0-4d41-8ad3-ff18122f837b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.590924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bf220-1cd0-4d41-8ad3-ff18122f837b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.591199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bf220-1cd0-4d41-8ad3-ff18122f837b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.594825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 772/1557] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/projects => generated 403 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:28.596062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace66ce-49cd-41ab-8232-51472fd96457 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.596353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace66ce-49cd-41ab-8232-51472fd96457 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.596651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace66ce-49cd-41ab-8232-51472fd96457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.611933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4b2bf220-1cd0-4d41-8ad3-ff18122f837b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.613112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4b2bf220-1cd0-4d41-8ad3-ff18122f837b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.618921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dace66ce-49cd-41ab-8232-51472fd96457 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.620543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dace66ce-49cd-41ab-8232-51472fd96457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.637874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:28.661290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:28.677902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 786/1558] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.679259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2bb70-390a-48ac-8e5a-2568fb40219f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.679545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2bb70-390a-48ac-8e5a-2568fb40219f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.679816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2bb70-390a-48ac-8e5a-2568fb40219f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.690196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 773/1559] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.691504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.691796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.692077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.699449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e8a2bb70-390a-48ac-8e5a-2568fb40219f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.700658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e8a2bb70-390a-48ac-8e5a-2568fb40219f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.709125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 787/1560] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.710391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.710743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.711026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.713085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.714294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.722313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 774/1561] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.723380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.731850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.733026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.733392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056bdcb5-ae35-4397-bb60-a5ca8887cba6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.737913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.738583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.738862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.739116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.739840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:28.740139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.741032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 788/1562] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.741891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.744264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.751075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1b386f-fd29-4fab-a695-d34724beb4b3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.755520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.756164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.756444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.763729 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 775/1563] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:28.763911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.763911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:28.764121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.764221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.764221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:57:28.764221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:57:28.764221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:57:28.764221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.767522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692aec28-af79-4b28-8aa2-ecd69eb61baa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.772063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b934df11-d59c-4edc-9cd0-0017ce3f66a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.772993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934df11-d59c-4edc-9cd0-0017ce3f66a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.773280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934df11-d59c-4edc-9cd0-0017ce3f66a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.773650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b934df11-d59c-4edc-9cd0-0017ce3f66a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.774266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934df11-d59c-4edc-9cd0-0017ce3f66a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.782708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 789/1564] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:28.782877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b934df11-d59c-4edc-9cd0-0017ce3f66a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.782973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.787376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a69b9d-55ac-4d80-ae9d-d6c05c43fe12 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.792873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.793538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.793819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.794123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.794845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:28.795179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.796768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.800671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 776/1565] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/users => generated 308 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:28.800671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.800671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.800671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.809673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 790/1566] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:28.810303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.821225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:28.822466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:28.825853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c2a62-63d3-4d82-b93b-e97001137950 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.830435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 777/1567] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:28.830567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.831204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.831330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.831629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.831904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.832621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:28.832929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.834539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.842978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec45e5e-5366-4b8f-b7e4-0a711a2578b5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.846473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 791/1568] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:28.847271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.849936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.850623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.850981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.851243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.851970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:28.852279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.854150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.859179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92683ef1-cd9d-4d01-96cb-a394a06c9993 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.863746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.864394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.864676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.864952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.865662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:28.865967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.873785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 778/1569] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:28.873785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.874050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.880172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 792/1570] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:28.880949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.883920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b8235-607c-4bcc-93f8-d27e332dd06b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.888909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.889552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.889829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.890439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.891130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.891297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df73dd-206c-42a6-a789-ee76bcbb29a1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.893021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.895881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.896515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.896799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.897085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.897840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.899735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.926306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 779/1571] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:28.926306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.931057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 793/1572] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:28.931057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:28.989950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d471b8-4af5-43c4-b0dd-8fc28e538006 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.993411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade75363-3ae1-4237-8132-8d0315e1300c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:28.994724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.995398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.995680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.995948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.996673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:28.997996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:28.998251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:28.998686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:28.998969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:28.999246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:28.999932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.001809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.008928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 780/1573] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.009743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.021980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003933f5-572a-482f-8f99-0e5ed44544c2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.027431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.028083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.028396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.028672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.029396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:29.029827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.034358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 794/1574] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:28 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.034569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.034674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.044207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 781/1575] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:29.044996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.060776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad8fa06-803a-4c11-824b-522633ef9393 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.078972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:29.084132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:29.099481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edb1db-9ec4-4327-a07e-a9f6abc37964 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.104638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.105305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.105580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.105825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.106537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.108450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.120641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.121297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.121582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.121863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.122592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.124700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.135216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 795/1576] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.136209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.152712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 782/1577] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.153721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.202635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb0bc1-1f5a-46ad-9384-82086dbe3fb2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.218996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df534-0c6c-40f9-bfbf-ccbf319da6fc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.223964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.224639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.224922 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.225196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.225920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.227869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.249103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 783/1578] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.249845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.259481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc53ad5-f4aa-4bd8-9a6c-cde216b7bf4b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.264225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.265155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.265372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.265503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.265705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.266053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.266332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.266478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.266744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.267436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.268287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.269399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.290099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 784/1579] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.291377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.298497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 796/1580] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.298497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.301779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb276fe4-cb53-4630-abd8-553dfd91df3b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.360497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.361385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.361660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.361928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] PATH_INFO: `/v3/projects/f2f87d8651d3430694abfe7c32b67bdb/users/e0047040a8224435a8b7721ba32910d9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.362301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cbdbff-8216-4cd8-8dd9-59f69ae2c75d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.370300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.370300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.370300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.370300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.370768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.370768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:57:29.370768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:57:29.370768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:57:29.371227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.380936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:29.383717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f87d8651d3430694abfe7c32b67bdb, user_id=e0047040a8224435a8b7721ba32910d9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.385076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:57:29.385076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:57:29.385076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:57:29.387167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.394271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 797/1581] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.395371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.403440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 785/1582] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:29 2022] PUT /identity/v3/projects/f2f87d8651d3430694abfe7c32b67bdb/users/e0047040a8224435a8b7721ba32910d9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:29.404333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.405702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59a9a-409d-49c2-a0e1-096204b4c947 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.408913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:29.465210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.465985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.466269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.466572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.467255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.469128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bada5d-b2a8-4e85-ae47-fdb2bd21b677 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.469275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.473761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.474435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.474736 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.475007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.475700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.478258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.499854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 798/1583] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.499854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.500119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 786/1584] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.500119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.509163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf4c3b2-ea62-44f9-af17-d8dd29361b2e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.561918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0dfc8-6bed-4ee4-a0bd-6977e6981a7b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.566859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.567246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.567547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.567833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.567937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.568115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.568275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.568482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.568816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.569208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.571107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.571239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.581292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 787/1585] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.585495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.595800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 799/1586] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.596485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.597342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209a230-ac55-4b2e-b75c-b799cf7f8e23 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.603021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.603682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.603986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.604260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.604973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.606737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.609457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2165f1a-e653-446c-805a-c6b1255a15d9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.614782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.615439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.615722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.615997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.617364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.618118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 788/1587] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.619021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.619609 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.628564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b80bc-3e52-415e-80ea-b0d17a68f460 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.634114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.634824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.635102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.635358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.636086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.637684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.642670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 800/1588] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.643509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.651476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 789/1589] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.652174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.657356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f5eea-ce57-4a97-ba66-f99314852129 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.661680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c1c41-ca87-4819-a286-e612559d166b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.662242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.662958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.663335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.663753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.664723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.666271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.666461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.666931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.667349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.667614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.668318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.669849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.677783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 801/1590] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.681701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.682237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 790/1591] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.682237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.689644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b9270-1532-4216-baee-25e052ed545d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.691850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85241539-274a-4db0-8935-49c982b01c93 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.695194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.695883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.696159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.696428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.696929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.697105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.697558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.697837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.698106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.698852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.699055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.700386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.712285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 791/1592] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.713147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.723238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 802/1593] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:29 2022] POST /identity/v3/users => generated 287 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:29.723459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d6767-e10f-4b56-a980-d9d110f93954 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.724053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.730991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.731646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.731926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.732194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.732912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.734176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b25def-544a-473d-ad66-7fed4b597137 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.734475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.739106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.739743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.740017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.740290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.741000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.742734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.745012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 792/1594] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.748278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.753637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 803/1595] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.754365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.755970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e9f45-333b-4223-b6e9-750fb79e6dff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.761497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.762212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.762528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.762807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.763534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.764193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a1ab3b-a262-462c-9fa9-fa3e0551cfd0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.765455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.769658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.770301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.770608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.770881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.772022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.773631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.776220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 793/1596] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.779409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.784992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 804/1597] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.785795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.786995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dce8e0-f805-429b-b95c-3d2c654fd5e6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.791821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.792131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:29.792685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.792961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.793231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] PATH_INFO: `/v3/projects/f2f87d8651d3430694abfe7c32b67bdb/users/e0047040a8224435a8b7721ba32910d9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.795332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2f87d8651d3430694abfe7c32b67bdb, user_id=e0047040a8224435a8b7721ba32910d9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.798031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.798613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f42981-3a74-4567-996b-40bbad7415f1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.803550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.804267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.804544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.804824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.805534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.807151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.809527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 794/1598] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:29 2022] PUT /identity/v3/projects/f2f87d8651d3430694abfe7c32b67bdb/users/e0047040a8224435a8b7721ba32910d9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:29.810174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.820783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 805/1599] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.820783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.822741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:29.828219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62c1e2-82f5-4660-9f60-58815059b07c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.880035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61257627-3ab3-4b66-9214-72cb649a6cf3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.884620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.884772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.885372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.885506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.885650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.885748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.885917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.886019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] PATH_INFO: `/v3/projects/ce2601d8ffd54c4aa0deaf0c2047b401/users/055c4e8c15c44f9da390da49528ded1e/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.886693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.888318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.899773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 806/1600] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.900732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.901805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce2601d8ffd54c4aa0deaf0c2047b401, user_id=055c4e8c15c44f9da390da49528ded1e, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.905058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.910533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229abc72-207a-4060-84fa-f5aa78d9d05e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.915733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.916391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.916676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.916953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.917677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:29.919296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:29.919993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 795/1601] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:29 2022] PUT /identity/v3/projects/ce2601d8ffd54c4aa0deaf0c2047b401/users/055c4e8c15c44f9da390da49528ded1e/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:29.923709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.929791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 807/1602] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:29.930520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:29.939866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1b42d8-c4aa-4d05-9a11-8ca4578ea06e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.985256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae802b-4d64-457c-be17-2ca86308ac58 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:29.989970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a84855-f0f5-4ee3-ba33-090f077aa01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.990965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a84855-f0f5-4ee3-ba33-090f077aa01c admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.991151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a84855-f0f5-4ee3-ba33-090f077aa01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.991502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a84855-f0f5-4ee3-ba33-090f077aa01c admin admin] PATH_INFO: `/v3/projects/2c86391ccd254aa09dbb9b303085f466/users/8f187472c6934541ac7ae3bb72464e6d/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.997410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:29.998229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:29.998543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:29.998811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:29.999540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.001156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.006192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a84855-f0f5-4ee3-ba33-090f077aa01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c86391ccd254aa09dbb9b303085f466, user_id=8f187472c6934541ac7ae3bb72464e6d, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.008899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a84855-f0f5-4ee3-ba33-090f077aa01c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.011662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 808/1603] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:30.012556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.023273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 796/1604] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:29 2022] PUT /identity/v3/projects/2c86391ccd254aa09dbb9b303085f466/users/8f187472c6934541ac7ae3bb72464e6d/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:30.024636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.024995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.025190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a77c06-d5fb-4061-a010-5130be767217 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.025539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.056470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] MFA Rules not processed for user `e0047040a8224435a8b7721ba32910d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.057696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.093551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.094515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.094793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.095066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] PATH_INFO: `/v3/projects/9fc3a6dd6ff1438f88fe786a71a735de/users/33dd51cac73b4712a8d0f4df9bfd0dda/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.110114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc3a6dd6ff1438f88fe786a71a735de, user_id=33dd51cac73b4712a8d0f4df9bfd0dda, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.112939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.116401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:30.125768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:30.127235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 809/1605] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:30 2022] PUT /identity/v3/projects/9fc3a6dd6ff1438f88fe786a71a735de/users/33dd51cac73b4712a8d0f4df9bfd0dda/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:30.128196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.136133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 797/1606] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.136985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.150007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd1a02f-fcde-4970-80f7-71ec53604d61 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.197582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb1461-044d-4848-95a4-36ab5df6631d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.202545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.203468 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.203752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.204045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] PATH_INFO: `/v3/projects/23a644f6b1e94809aa845fc61ed2b48f/users/c5ef575152d54c92af80295e1f89603d/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.208010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512be888-eacb-4946-95ef-23243190e40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.208685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be888-eacb-4946-95ef-23243190e40f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.208968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be888-eacb-4946-95ef-23243190e40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.209241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512be888-eacb-4946-95ef-23243190e40f admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.209997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be888-eacb-4946-95ef-23243190e40f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.211676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512be888-eacb-4946-95ef-23243190e40f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.219368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a644f6b1e94809aa845fc61ed2b48f, user_id=c5ef575152d54c92af80295e1f89603d, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.222350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 798/1607] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:30.222539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.223720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.224015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.224294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.239358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 810/1608] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:30 2022] PUT /identity/v3/projects/23a644f6b1e94809aa845fc61ed2b48f/users/c5ef575152d54c92af80295e1f89603d/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:30.240280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.242633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.244005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.301997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 799/1609] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.302751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.304420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3b26c-61fb-46bb-a21e-dcb9b01b2ff1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.309851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7dcf6-e68f-4007-89f5-ee5e5f0ee00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.310885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7dcf6-e68f-4007-89f5-ee5e5f0ee00f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.311179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7dcf6-e68f-4007-89f5-ee5e5f0ee00f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.311451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7dcf6-e68f-4007-89f5-ee5e5f0ee00f admin admin] PATH_INFO: `/v3/projects/ef17643ceae44325a3f16cd3dcd8e3f8/users/53afa795849e439b8497b9f388d5735e/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.312746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110c519-b3d4-44e3-a680-50813bbb73ee None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.317581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec7203-76d7-43f2-bf30-1652f071bcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.318520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec7203-76d7-43f2-bf30-1652f071bcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.319290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec7203-76d7-43f2-bf30-1652f071bcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.319290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec7203-76d7-43f2-bf30-1652f071bcd3 admin admin] PATH_INFO: `/v3/projects/21880f354bf546fe8c2ce54d73b2db0e/users/b374f2c1ae8b4967b930e2abc4d5b463/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.327548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7dcf6-e68f-4007-89f5-ee5e5f0ee00f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef17643ceae44325a3f16cd3dcd8e3f8, user_id=53afa795849e439b8497b9f388d5735e, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.330365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7dcf6-e68f-4007-89f5-ee5e5f0ee00f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.334335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec7203-76d7-43f2-bf30-1652f071bcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21880f354bf546fe8c2ce54d73b2db0e, user_id=b374f2c1ae8b4967b930e2abc4d5b463, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.337443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ec7203-76d7-43f2-bf30-1652f071bcd3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.345196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 811/1610] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:30 2022] PUT /identity/v3/projects/ef17643ceae44325a3f16cd3dcd8e3f8/users/53afa795849e439b8497b9f388d5735e/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:30.346699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.346966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.347236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.350960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 800/1611] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:30 2022] PUT /identity/v3/projects/21880f354bf546fe8c2ce54d73b2db0e/users/b374f2c1ae8b4967b930e2abc4d5b463/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:30.352273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.352598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.352874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.371394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.373078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.376152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] MFA Rules not processed for user `8f187472c6934541ac7ae3bb72464e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.377342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.424361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:30.435216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 801/1612] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.436130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.446723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 812/1613] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.449669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:30.455323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.466765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43593d-52e7-4b83-91b5-701a10438d5d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.471682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ac790-6852-4add-a003-fadd6a152190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.472614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ac790-6852-4add-a003-fadd6a152190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.473019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ac790-6852-4add-a003-fadd6a152190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.473186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ac790-6852-4add-a003-fadd6a152190 admin admin] PATH_INFO: `/v3/projects/1db77fcdce1143198fb360778bfd177a/users/bd32fa9b547c40e7b6f1fc0d03b52c7f/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.490197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ac790-6852-4add-a003-fadd6a152190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db77fcdce1143198fb360778bfd177a, user_id=bd32fa9b547c40e7b6f1fc0d03b52c7f, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.493070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ac790-6852-4add-a003-fadd6a152190 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.505274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b31be0a-b65a-45d3-acef-e50c6d6dcbcd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.506174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 813/1614] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:30 2022] PUT /identity/v3/projects/1db77fcdce1143198fb360778bfd177a/users/bd32fa9b547c40e7b6f1fc0d03b52c7f/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:30.508134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.508134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.508134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.526810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.527987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.557937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcf7589-0438-4865-90bb-f466af883b0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.558539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7589-0438-4865-90bb-f466af883b0c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.558821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7589-0438-4865-90bb-f466af883b0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.559095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf7589-0438-4865-90bb-f466af883b0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.590248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 814/1615] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.591237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.626616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf7589-0438-4865-90bb-f466af883b0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.628091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcf7589-0438-4865-90bb-f466af883b0c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.638663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 802/1616] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:30.640253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f868e-b53d-4d14-a0e5-1aa6ba09bb60 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.640541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f868e-b53d-4d14-a0e5-1aa6ba09bb60 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.640816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f868e-b53d-4d14-a0e5-1aa6ba09bb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.645320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d60fc7-6b84-4e9e-b2b2-526504f4c91c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.649307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.649996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.650275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.650583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.657798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8c8f868e-b53d-4d14-a0e5-1aa6ba09bb60 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.659011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c8f868e-b53d-4d14-a0e5-1aa6ba09bb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.660435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.661844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.667129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 803/1617] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.669207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.669679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.669955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.675620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 815/1618] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:30.676518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.685156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9780d929-3db6-4980-9857-834a6921fc2b service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.688906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafc140-da8d-400b-9b44-1b4e5302d13e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.689550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc140-da8d-400b-9b44-1b4e5302d13e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.689827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc140-da8d-400b-9b44-1b4e5302d13e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.690149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafc140-da8d-400b-9b44-1b4e5302d13e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.703554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] MFA Rules not processed for user `b374f2c1ae8b4967b930e2abc4d5b463`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.704761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.706634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafc140-da8d-400b-9b44-1b4e5302d13e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.708089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafc140-da8d-400b-9b44-1b4e5302d13e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.718922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 816/1619] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:30.720362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c07ac-4ec2-4d1f-8b3d-d5f716f23384 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.720654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c07ac-4ec2-4d1f-8b3d-d5f716f23384 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.720932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c07ac-4ec2-4d1f-8b3d-d5f716f23384 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.722367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 817/1620] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 09:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:57:30.728392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb586-256b-4e72-b7e5-a0681db07673 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.728814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb586-256b-4e72-b7e5-a0681db07673 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.728978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb586-256b-4e72-b7e5-a0681db07673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.768267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-462fb586-256b-4e72-b7e5-a0681db07673 None None] MFA Rules not processed for user `bd32fa9b547c40e7b6f1fc0d03b52c7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.769545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-462fb586-256b-4e72-b7e5-a0681db07673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.802999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 804/1621] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.804606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.812558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:30.829594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd9428-19ca-4595-afe9-7ccc4f931c0f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.839061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.839734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.840609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.840609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.859317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:30.869504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.871200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.887398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 805/1622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:30.888384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.898835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45806d-215d-4982-9c63-1e2d722f2903 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.901017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 818/1623] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:30.902935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.907458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.907755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.915312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.916096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.916469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.916747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.928251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.929758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:30.948236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 806/1624] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:30.949848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:30.959840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:30.961284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:30.962524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73146a0-7f29-4b51-8064-93fc08bd1760 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:30.971858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:30.973523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:30.974048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:30.974429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:30.975236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:30.977697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.040876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 807/1625] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:31.040876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.081571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 819/1626] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 09:57:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:31.082705 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.097216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40084b72-d7a3-429e-b6a7-4b17e6a11aa2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.136348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7f3480-e3e8-4695-9736-c6703ed5281c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.144826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.145830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.146289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.146761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.148022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.151123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.197001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.200553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.200725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 808/1627] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:31 2022] POST /identity/v3/projects => generated 371 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:31.200876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.200876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] PATH_INFO: `/v3/users/3469207da54047d8a57e1a1fd82d70eb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.201055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.202101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3469207da54047d8a57e1a1fd82d70eb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.204727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.297932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3469207da54047d8a57e1a1fd82d70eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:31.321370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe9e10-cb16-432c-b862-693cd03e4cd2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.330186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.331139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.331476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.331759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.332251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3469207da54047d8a57e1a1fd82d70eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:31.332503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.334661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.338707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:31.355715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3469207da54047d8a57e1a1fd82d70eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:31.376538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3469207da54047d8a57e1a1fd82d70eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:31.377350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3469207da54047d8a57e1a1fd82d70eb'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:31.385907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 809/1628] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:31 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:31.387795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.391946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:31.394105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 820/1629] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:31 2022] DELETE /identity/v3/users/3469207da54047d8a57e1a1fd82d70eb => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:31.397741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.404816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:31.464361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:31.498999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd41be6-6bbd-4e3e-a33a-7b146d55ad2f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.508216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.509229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.509523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.509937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.510756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.513786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.537556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b218f4be-4629-4802-a530-e859170196ec admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.542288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 821/1630] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:31 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:31.543481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.546317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:31.591450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2693ed-ce6b-4dee-b42a-2a5df92a6616 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.611540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f710dd-043b-4ee5-aae8-890626fd785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.612235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f710dd-043b-4ee5-aae8-890626fd785b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.612520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f710dd-043b-4ee5-aae8-890626fd785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.612798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f710dd-043b-4ee5-aae8-890626fd785b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.614007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f710dd-043b-4ee5-aae8-890626fd785b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.615899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f710dd-043b-4ee5-aae8-890626fd785b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.641482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 822/1631] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:31.643892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.645450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.645758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.686272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:31.690252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:31.705452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.708843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.709360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.709826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.710485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 823/1632] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:31.711446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.715067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:31.732156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0b46a4-c0d5-425a-8dcc-d8c88c2116ad None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.746329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.746965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.747255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.747567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.748669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.750015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.776689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 824/1633] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:31 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:31.777423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.799145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c392-466d-48b5-8493-3609ad8c9c2a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:31.816686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:31.817623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:31.817910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:31.818202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] PATH_INFO: `/v3/projects/7c850be1501f49d1b82daa5f12e9b9c7/users/296f6d9a64e04a03925630262ee1db9c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:31.840558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.842393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.853559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c850be1501f49d1b82daa5f12e9b9c7, user_id=296f6d9a64e04a03925630262ee1db9c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:31.854041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 810/1634] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:31.856686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:31.872362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:31.876168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:31.883580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 825/1635] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:31 2022] PUT /identity/v3/projects/7c850be1501f49d1b82daa5f12e9b9c7/users/296f6d9a64e04a03925630262ee1db9c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:31.883580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.028966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075b01c8-6efc-4682-b3d2-cf2b88371551 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.042338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.043187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.043479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.043797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] PATH_INFO: `/v3/projects/5728b3ba416e434ba244ae6c3a1d478e/users/1536f50ce66646309e8044fcab0fc52c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.054661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3225b2-d295-43ca-b0d2-0a12da475963 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.080303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5728b3ba416e434ba244ae6c3a1d478e, user_id=1536f50ce66646309e8044fcab0fc52c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.083054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.094880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:32.109237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 826/1636] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:31 2022] PUT /identity/v3/projects/5728b3ba416e434ba244ae6c3a1d478e/users/1536f50ce66646309e8044fcab0fc52c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:32.110195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.121960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:32.179557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.180519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.180976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.181420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.200646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.202406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.235430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 811/1637] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:32.238248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.245389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52697d0-03db-466b-a1e2-2b1dd6c433e8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.251246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.252036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.252494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.252846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.253702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.255699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.271139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 827/1638] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:32.273196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.274179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb47025f-4b43-4dcd-8f47-0e1f92152b80 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.285270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8d916-d11a-4636-acda-bc0d1156e46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.287336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8d916-d11a-4636-acda-bc0d1156e46e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.287633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8d916-d11a-4636-acda-bc0d1156e46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.287915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8d916-d11a-4636-acda-bc0d1156e46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.288023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ebf48-b32c-4b12-8115-929c13f7e0ed admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.288771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8d916-d11a-4636-acda-bc0d1156e46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.292843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.293919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.294363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.294691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] PATH_INFO: `/v3/projects/7c850be1501f49d1b82daa5f12e9b9c7/users/296f6d9a64e04a03925630262ee1db9c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.295253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8d916-d11a-4636-acda-bc0d1156e46e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.297142 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c850be1501f49d1b82daa5f12e9b9c7, user_id=296f6d9a64e04a03925630262ee1db9c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.300600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.323181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 812/1639] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:32.336659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 828/1640] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:32 2022] PUT /identity/v3/projects/7c850be1501f49d1b82daa5f12e9b9c7/users/296f6d9a64e04a03925630262ee1db9c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:32.336659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.336943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88dff-cc8f-4c14-aee3-c9ba7da09559 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.336943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88dff-cc8f-4c14-aee3-c9ba7da09559 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.336943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b88dff-cc8f-4c14-aee3-c9ba7da09559 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.338067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 813/1641] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 09:57:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:57:32.339595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8628f3-0244-4b15-bb3b-c7b78ac3d6f1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.340041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8628f3-0244-4b15-bb3b-c7b78ac3d6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.340409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8628f3-0244-4b15-bb3b-c7b78ac3d6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.399662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0c8628f3-0244-4b15-bb3b-c7b78ac3d6f1 None None] MFA Rules not processed for user `296f6d9a64e04a03925630262ee1db9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:32.401984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c8628f3-0244-4b15-bb3b-c7b78ac3d6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:32.442932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0049b1-6db2-46e5-a268-16dee72a3112 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.449833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c61af8-1b4e-4333-bd0b-d725f2a42363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.451500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61af8-1b4e-4333-bd0b-d725f2a42363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.452485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61af8-1b4e-4333-bd0b-d725f2a42363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.452975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c61af8-1b4e-4333-bd0b-d725f2a42363 admin admin] PATH_INFO: `/v3/projects/5728b3ba416e434ba244ae6c3a1d478e/users/1536f50ce66646309e8044fcab0fc52c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.455649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c61af8-1b4e-4333-bd0b-d725f2a42363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5728b3ba416e434ba244ae6c3a1d478e, user_id=1536f50ce66646309e8044fcab0fc52c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.459966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c61af8-1b4e-4333-bd0b-d725f2a42363 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.476815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 829/1642] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:32 2022] PUT /identity/v3/projects/5728b3ba416e434ba244ae6c3a1d478e/users/1536f50ce66646309e8044fcab0fc52c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:32.478357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.478745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.479066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.520684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:32.524200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:32.570161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 814/1643] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:32.574740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.575025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.575304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.637921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] MFA Rules not processed for user `1536f50ce66646309e8044fcab0fc52c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:32.639202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:32.642408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 830/1644] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:57:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:32.643522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.645616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:32.686469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:32.755460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24e165-fcaa-4494-bcb1-b91b2dff09c9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.759556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.760226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.760511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.760883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.792801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 815/1645] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:32 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:32.792801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.793528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:32.821136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c67743-ddcb-41ff-bf0f-dd526a693e29 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.827100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.830036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.830573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.831000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.852980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.856190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.863111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.865087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:32.877391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 816/1646] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:32.879154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 831/1647] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:32.950670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:32.960430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe16bd8-1f0e-487e-82e2-5298bb14eca5 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:32.964364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:32.965152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:32.965530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:32.965899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:32.976365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:32.979977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:32.981825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:33.003125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 817/1648] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:33.270773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:33.280930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bc9b5-3114-4234-84f1-c0350e504236 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:33.286607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:33.288297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:33.288589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:33.289104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:33.295593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:33.391415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:33.392951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:33.421273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 832/1649] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:33.965464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:33.967598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:34.160858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575941da-9b8f-4ef9-9968-111421767753 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:34.166380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:34.167664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:34.168164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:34.168709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] PATH_INFO: `/v3/projects/8694ed2828fc49cba4e17907cd4ba298` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:34.172843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8694ed2828fc49cba4e17907cd4ba298)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:34.175047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:34.276870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8694ed2828fc49cba4e17907cd4ba298', 'request_id': 'req-ebc117ba-d21a-427e-86eb-9135a28501e7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.294313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8694ed2828fc49cba4e17907cd4ba298', 'request_id': 'req-ebc117ba-d21a-427e-86eb-9135a28501e7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.307927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:34.314573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8694ed2828fc49cba4e17907cd4ba298', 'request_id': 'req-ebc117ba-d21a-427e-86eb-9135a28501e7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.331750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15669df4-0031-44c5-930a-a5a4236e196c service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:34.340722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] The token cache is being invalidate because project 8694ed2828fc49cba4e17907cd4ba298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:34.347395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.349052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.356147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 818/1650] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:33 2022] DELETE /identity/v3/projects/8694ed2828fc49cba4e17907cd4ba298 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:34.358133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:34.364770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:34.405617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:34.406539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:34.406827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:34.407102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] PATH_INFO: `/v3/users/b374f2c1ae8b4967b930e2abc4d5b463` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:34.408321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b374f2c1ae8b4967b930e2abc4d5b463)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:34.410253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:34.423784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:34.517334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc117ba-d21a-427e-86eb-9135a28501e7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:34.522864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b374f2c1ae8b4967b930e2abc4d5b463'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.533723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:34.535684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:34.537152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:34.539251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] PATH_INFO: `/v3/users/e0047040a8224435a8b7721ba32910d9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:34.541442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0047040a8224435a8b7721ba32910d9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:34.543596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: WARNING py.warnings [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:57:34.543596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: warnings.warn(msg) Jul 13 09:57:34.543596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: Jul 13 09:57:34.544937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b374f2c1ae8b4967b930e2abc4d5b463'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.546318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:34.557388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b374f2c1ae8b4967b930e2abc4d5b463'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.568312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b374f2c1ae8b4967b930e2abc4d5b463'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.569060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78ec1231-f122-4cf5-95ee-93c1ce1a5663 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b374f2c1ae8b4967b930e2abc4d5b463'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.582512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 833/1651] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:34 2022] DELETE /identity/v3/users/b374f2c1ae8b4967b930e2abc4d5b463 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:34.582512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75962a-0450-435e-b8e4-fa8ff8aa1200 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:34.582512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75962a-0450-435e-b8e4-fa8ff8aa1200 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:34.582512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75962a-0450-435e-b8e4-fa8ff8aa1200 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:34.586614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 834/1652] 10.222.0.17 () {54 vars in 961 bytes} [Wed Jul 13 09:57:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:57:34.586940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:34.587222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:34.587505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:34.609575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:34.633803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:34.635197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:34.648888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0047040a8224435a8b7721ba32910d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.712515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0047040a8224435a8b7721ba32910d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.732119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0047040a8224435a8b7721ba32910d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.733076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0047040a8224435a8b7721ba32910d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.771923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-9cc29bc0-bda4-4b4d-9485-cfc3c6f6f0cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0047040a8224435a8b7721ba32910d9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:34.793424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 819/1653] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:34 2022] DELETE /identity/v3/users/e0047040a8224435a8b7721ba32910d9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:34.795832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3336a2-24ac-4067-b9c1-86d7e1c895e0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:34.796938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3336a2-24ac-4067-b9c1-86d7e1c895e0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:34.798980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3336a2-24ac-4067-b9c1-86d7e1c895e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:34.812559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 835/1654] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:34.837572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-db3336a2-24ac-4067-b9c1-86d7e1c895e0 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:34.839147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-db3336a2-24ac-4067-b9c1-86d7e1c895e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:34.905645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:34.907619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:35.051167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 820/1655] 10.222.0.17 () {58 vars in 1058 bytes} [Wed Jul 13 09:57:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:35.062549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7a65-3d14-4af5-998e-ecc39ef7ef51 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:35.063035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7a65-3d14-4af5-998e-ecc39ef7ef51 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:35.063495 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7a65-3d14-4af5-998e-ecc39ef7ef51 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:35.063626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d8ca0-8700-49de-bc9a-d05a568cb4f3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:35.066223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 821/1656] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 09:57:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:57:35.076364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:35.076894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:35.077351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:35.112503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:35.113764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:35.141500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 822/1657] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:57:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:57:35.155923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:35.157420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:35.168906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:35.195109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:35.195484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:35.195769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:35.196090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:35.279241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571bf1db-878c-4bd9-bb24-f0af869eeeef None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:35.290583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544114-b975-49e0-8662-bac60121919d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:35.291276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544114-b975-49e0-8662-bac60121919d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:35.291562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544114-b975-49e0-8662-bac60121919d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:35.291840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83544114-b975-49e0-8662-bac60121919d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:35.303742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:35.311314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:35.311968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83544114-b975-49e0-8662-bac60121919d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:35.312931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83544114-b975-49e0-8662-bac60121919d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:35.336162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 836/1658] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:35.349456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 823/1659] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:36.254300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:36.255803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:36.282827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb71fd6-b597-44c9-bfba-9702637b459d service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:36.293571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:36.298627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:36.298918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:36.299200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] PATH_INFO: `/v3/projects/21880f354bf546fe8c2ce54d73b2db0e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:36.300598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21880f354bf546fe8c2ce54d73b2db0e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:36.301653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: WARNING py.warnings [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 13 09:57:36.301653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: warnings.warn(msg) Jul 13 09:57:36.301653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: Jul 13 09:57:36.302893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:36.484981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21880f354bf546fe8c2ce54d73b2db0e', 'request_id': 'req-83d4c04e-6d91-4d74-bf87-9355dda1bac1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.505516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21880f354bf546fe8c2ce54d73b2db0e', 'request_id': 'req-83d4c04e-6d91-4d74-bf87-9355dda1bac1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.529392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21880f354bf546fe8c2ce54d73b2db0e', 'request_id': 'req-83d4c04e-6d91-4d74-bf87-9355dda1bac1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.557725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] The token cache is being invalidate because project 21880f354bf546fe8c2ce54d73b2db0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:36.558372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.559426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.589053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 837/1660] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:36 2022] DELETE /identity/v3/projects/21880f354bf546fe8c2ce54d73b2db0e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:36.589903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544114-b975-49e0-8662-bac60121919d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:36.609451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83544114-b975-49e0-8662-bac60121919d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:36.678748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:36.751160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:36.752071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:36.754625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:36.754942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] PATH_INFO: `/v3/users/296f6d9a64e04a03925630262ee1db9c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:36.758049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] RBAC: Authorizing `identity:delete_user(user_id=296f6d9a64e04a03925630262ee1db9c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:36.760210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:36.906327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '296f6d9a64e04a03925630262ee1db9c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.926114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '296f6d9a64e04a03925630262ee1db9c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.938341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '296f6d9a64e04a03925630262ee1db9c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.939274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '296f6d9a64e04a03925630262ee1db9c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.955448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1dae8a22-1d4c-48e4-ac83-2b2056c3f91c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '296f6d9a64e04a03925630262ee1db9c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:36.966782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 824/1661] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:36 2022] DELETE /identity/v3/users/296f6d9a64e04a03925630262ee1db9c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:57:37.431110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:37.438367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:37.469482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4c04e-6d91-4d74-bf87-9355dda1bac1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:37.602851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:37.603910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:37.604293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:37.604671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] PATH_INFO: `/v3/projects/f2f87d8651d3430694abfe7c32b67bdb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:37.607195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2f87d8651d3430694abfe7c32b67bdb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:37.613772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:37.645802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:37.732165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2f87d8651d3430694abfe7c32b67bdb', 'request_id': 'req-a78c3063-a064-4ef5-add4-a89c42601f2d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:37.740467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2f87d8651d3430694abfe7c32b67bdb', 'request_id': 'req-a78c3063-a064-4ef5-add4-a89c42601f2d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:37.751092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2f87d8651d3430694abfe7c32b67bdb', 'request_id': 'req-a78c3063-a064-4ef5-add4-a89c42601f2d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:37.768405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] The token cache is being invalidate because project f2f87d8651d3430694abfe7c32b67bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:37.768859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:37.769752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a78c3063-a064-4ef5-add4-a89c42601f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:37.771975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 838/1662] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:37 2022] DELETE /identity/v3/projects/f2f87d8651d3430694abfe7c32b67bdb => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:37.777598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:37.778175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:37.778255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:37.809080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:37.810808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:37.936903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef841-f262-4648-a08e-607c1ce11267 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:37.937388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef841-f262-4648-a08e-607c1ce11267 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:37.937958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accef841-f262-4648-a08e-607c1ce11267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:37.946177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 825/1663] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:57:37.978317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-accef841-f262-4648-a08e-607c1ce11267 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:37.980214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-accef841-f262-4648-a08e-607c1ce11267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:38.007320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:38.013939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 839/1664] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:57:38.019648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5728d-4c28-437b-8757-b961d7ea92b5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:38.025739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:38.026205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.026577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.026856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.027690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:38.028006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:38.029748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:38.052658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 826/1665] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:38.058162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef841-f262-4648-a08e-607c1ce11267 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:38.073214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accef841-f262-4648-a08e-607c1ce11267 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:38.080752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:38.080752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.081144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.081144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.081932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:38.084777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:38.142607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:38.151137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 840/1666] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:38 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:38.161117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87733002-c144-4269-8649-eee2d342d5f4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:38.255622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:38.287788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:38.288619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.289008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.289343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.290127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:38.292512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:38.339111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 827/1667] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:38 2022] POST /identity/v3/users => generated 282 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:38.339699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:38.361231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c883145-5d0a-4de5-9d64-b9eb24d8d931 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:38.382185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:38.388771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.389081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.389365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.391021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:38.392871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:38.424357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 841/1668] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:57:38.424640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:38.448497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2e79f-1599-4575-8cbf-5aff5b13f1fa admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:38.467664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2586b331-343f-4fd5-88f8-898a0ab0799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:38.468379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b331-343f-4fd5-88f8-898a0ab0799a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.468664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b331-343f-4fd5-88f8-898a0ab0799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.468941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2586b331-343f-4fd5-88f8-898a0ab0799a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.469728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b331-343f-4fd5-88f8-898a0ab0799a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:38.486766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2586b331-343f-4fd5-88f8-898a0ab0799a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:38.510582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:38.520124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 828/1669] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:38.528856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bbe45-6d3e-48a8-9175-0a5888788756 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:38.548015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:38.552878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.553337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.554231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] PATH_INFO: `/v3/projects/e21afcc281bc4fbb9841757e428ca003/users/bfbcffa386b54c0fb96f588a2da1dd05/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.599827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e21afcc281bc4fbb9841757e428ca003, user_id=bfbcffa386b54c0fb96f588a2da1dd05, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:38.605782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:38.656547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 842/1670] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:38 2022] PUT /identity/v3/projects/e21afcc281bc4fbb9841757e428ca003/users/bfbcffa386b54c0fb96f588a2da1dd05/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:57:38.658774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:38.659397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:38.659831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:38.741409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] MFA Rules not processed for user `bfbcffa386b54c0fb96f588a2da1dd05`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:38.744370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:38.965472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 829/1671] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:38.966094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:39.218680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168fb834-212e-41fb-8843-f3e648034ab9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:39.232499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:39.250456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:39.251146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:39.254174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:39.255806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:39.258073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:39.330762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 843/1672] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:38 2022] POST /identity/v3/projects => generated 365 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:57:39.335183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:39.349452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bd6e8-7860-4783-9896-be7925329e28 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:39.517416 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:39.518732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:39.519443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:39.519950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:39.521149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:39.546334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:39.635480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 830/1673] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:39 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:39.639492 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:39.655663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40f92fd-acc2-402d-824c-94548eb1a248 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:39.685166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88301315-d87f-47f8-92b0-c621f954e147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:39.685871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88301315-d87f-47f8-92b0-c621f954e147 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:39.686159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88301315-d87f-47f8-92b0-c621f954e147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:39.686442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88301315-d87f-47f8-92b0-c621f954e147 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:39.692197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88301315-d87f-47f8-92b0-c621f954e147 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:39.693840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88301315-d87f-47f8-92b0-c621f954e147 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:39.729859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 844/1674] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:39.733973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:39.751548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e2db1-ef65-430d-81e5-585b0844bc16 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:39.768143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:39.769349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:39.769803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:39.770088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] PATH_INFO: `/v3/projects/e63c866b15ba4617adb80d7ad2d96af2/users/45d3abf90dc043a4881f1d4a83252ace/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:39.796580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:39.797012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:39.797504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:39.803872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63c866b15ba4617adb80d7ad2d96af2, user_id=45d3abf90dc043a4881f1d4a83252ace, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:39.807670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:39.837650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 831/1675] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:39 2022] PUT /identity/v3/projects/e63c866b15ba4617adb80d7ad2d96af2/users/45d3abf90dc043a4881f1d4a83252ace/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:39.841314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:39.863194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:39.869241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:39.913200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] MFA Rules not processed for user `055c4e8c15c44f9da390da49528ded1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:39.914969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:39.930704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54485365-42f8-4049-b555-96c9a0b2d52a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:39.937665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:39.938743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:39.939075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:39.940098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:39.940916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:39.943193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:39.960074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 832/1676] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:57:39.960074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:39.961142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:39.988292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d914c71c-ab58-4ee6-a891-1edb528011cb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:40.001473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:40.002625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.003066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.003467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] PATH_INFO: `/v3/projects/7c850be1501f49d1b82daa5f12e9b9c7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.009334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c850be1501f49d1b82daa5f12e9b9c7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:40.013367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:40.088002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 845/1677] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:40.088002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:40.113763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236451f-f183-4749-ac2d-309f6082cf01 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:40.131207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c850be1501f49d1b82daa5f12e9b9c7', 'request_id': 'req-385e39df-8aa9-4680-8ff3-4627ccb097ae'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:40.152114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c850be1501f49d1b82daa5f12e9b9c7', 'request_id': 'req-385e39df-8aa9-4680-8ff3-4627ccb097ae'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:40.168805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c850be1501f49d1b82daa5f12e9b9c7', 'request_id': 'req-385e39df-8aa9-4680-8ff3-4627ccb097ae'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:40.206451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] The token cache is being invalidate because project 7c850be1501f49d1b82daa5f12e9b9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:40.206793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:40.208269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-385e39df-8aa9-4680-8ff3-4627ccb097ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:40.210067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 833/1678] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:39 2022] DELETE /identity/v3/projects/7c850be1501f49d1b82daa5f12e9b9c7 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:40.212209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811c5d6-35aa-4dcf-a975-4a70aa61ccda None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.212490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811c5d6-35aa-4dcf-a975-4a70aa61ccda None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.212766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811c5d6-35aa-4dcf-a975-4a70aa61ccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.273630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f811c5d6-35aa-4dcf-a975-4a70aa61ccda None None] MFA Rules not processed for user `055c4e8c15c44f9da390da49528ded1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:40.277251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f811c5d6-35aa-4dcf-a975-4a70aa61ccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.311882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b669bc52-db5e-4839-8b17-effdb5513ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:40.312796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bc52-db5e-4839-8b17-effdb5513ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.313087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bc52-db5e-4839-8b17-effdb5513ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.313342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b669bc52-db5e-4839-8b17-effdb5513ff9 admin admin] PATH_INFO: `/v3/projects/e63c866b15ba4617adb80d7ad2d96af2/users/45d3abf90dc043a4881f1d4a83252ace/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.329049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bc52-db5e-4839-8b17-effdb5513ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e63c866b15ba4617adb80d7ad2d96af2, user_id=45d3abf90dc043a4881f1d4a83252ace, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:40.331793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b669bc52-db5e-4839-8b17-effdb5513ff9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:40.381504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 846/1679] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:40 2022] PUT /identity/v3/projects/e63c866b15ba4617adb80d7ad2d96af2/users/45d3abf90dc043a4881f1d4a83252ace/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:40.383153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.383614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.384037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.424301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:40.424515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 834/1680] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:40.425663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.425875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b234-1b37-4472-ac48-3069b0ece5b7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.426168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b234-1b37-4472-ac48-3069b0ece5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.426468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18b234-1b37-4472-ac48-3069b0ece5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.503397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ec18b234-1b37-4472-ac48-3069b0ece5b7 None None] MFA Rules not processed for user `45d3abf90dc043a4881f1d4a83252ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:40.504623 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ec18b234-1b37-4472-ac48-3069b0ece5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.560453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 847/1681] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:40.563939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:40.566992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.569858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:40.691974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 835/1682] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:40.693469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.693768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.694025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.738804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:40.742073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:40.743427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.762934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 836/1683] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:40.763809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:40.767848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.813828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4dc3f0-0291-4abc-90bb-02fdc510d77e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:40.840540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:40.841216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.841502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.841775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.847454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:40.901924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805ada9-ba91-4e07-9bc8-31e41131c408 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:40.909052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:40.909735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:40.910668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:40.910965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:40.939432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:40.941090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:40.964538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 837/1684] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:40.965403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:40.967495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:40.987878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:40.989855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09f6c3-1da3-4337-9f95-a12ca7c08f04 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.007302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.008356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.008770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.009162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.010036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:41.010488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.012408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.042084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 838/1685] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:41.044469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 848/1686] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:41.046962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:41.062983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98850c54-0945-4639-bc1a-3a4356affc71 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.068898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.069774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.070150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.070575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.071480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.073539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.134166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 839/1687] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:41 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:41.138815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:41.157776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6ff45b-1e26-474a-b54e-e4e8b4af9627 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.251560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:41.343364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.344082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.344362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.344697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.345408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.347382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.417032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 849/1688] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:41 2022] POST /identity/v3/users => generated 295 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:41.419217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:41.431046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b5319-b6e7-4a64-ace9-d92fee0763e6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.441994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.442704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.442985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.443261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.446880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eac3fa7-6799-4c1c-86f2-c988a79b91ad admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.448716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:41.463905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.464609 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.464891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.465165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.465909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.474007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.508471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 850/1689] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:41.510105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:41.528525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fee9ed-ee83-4ae8-845f-b0799ba367bd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.539700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.540689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.541166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.541613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.542542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.545103 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.562770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:41.565838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 851/1690] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:41.570927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:41.594817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84c034-e4c6-460d-a119-5c6d87f4ea3c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:41.605153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:41.607570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.608942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.609235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] PATH_INFO: `/v3/projects/939f03d48c5f45b893f7ff82b3bb27e2/users/4222bfaf62ba4082901cf564c01fed56/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.612598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.615594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d31a554-622f-4826-9a54-66810933be54 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.664417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 840/1691] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:41.668488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=939f03d48c5f45b893f7ff82b3bb27e2, user_id=4222bfaf62ba4082901cf564c01fed56, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:41.671220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:41.729358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 852/1692] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:41 2022] PUT /identity/v3/projects/939f03d48c5f45b893f7ff82b3bb27e2/users/4222bfaf62ba4082901cf564c01fed56/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:41.734806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:41.735216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:41.735572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:41.832333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] MFA Rules not processed for user `4222bfaf62ba4082901cf564c01fed56`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:41.833551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:41.990653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 841/1693] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:41.995315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:42.032765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:42.136345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a411517a-a828-4222-b2d7-046945924b3c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:42.146465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:42.147575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.147959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.148822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.149278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:42.151376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:42.239395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 853/1694] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:41 2022] POST /identity/v3/projects => generated 389 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:42.244210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:42.261504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dab11-2b55-4987-bd7b-8a3b3fb3d4fb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:42.404997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:42.405690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.405978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.406256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.407394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:42.409378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:42.452404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 842/1695] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:42 2022] POST /identity/v3/users => generated 301 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:42.456371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:42.473522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ec4be8-8df6-42e7-bddb-6299e8246890 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:42.520185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:42.521124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.522826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.526269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.527399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:42.531556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:42.583263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 854/1696] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:42.586092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:42.604187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995e4ac-2b07-4b62-ad23-9be6e7b1122a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:42.610398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:42.611619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.612087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.612571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] PATH_INFO: `/v3/projects/e6898ee837a941979dc40c4ba7781181/users/33b295b0cb0146fdaf782c77d20d7354/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.635439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6898ee837a941979dc40c4ba7781181, user_id=33b295b0cb0146fdaf782c77d20d7354, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:42.641743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:42.682195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 843/1697] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:42 2022] PUT /identity/v3/projects/e6898ee837a941979dc40c4ba7781181/users/33b295b0cb0146fdaf782c77d20d7354/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:42.686287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:42.700319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be69f92e-d67e-4c1c-8a48-89a6ab835696 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:42.845108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9de24-d6a5-42ec-bc87-d2e93ecb02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:42.846770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9de24-d6a5-42ec-bc87-d2e93ecb02f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.847824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9de24-d6a5-42ec-bc87-d2e93ecb02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.848273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9de24-d6a5-42ec-bc87-d2e93ecb02f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.849180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9de24-d6a5-42ec-bc87-d2e93ecb02f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:42.852008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9de24-d6a5-42ec-bc87-d2e93ecb02f9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:42.883501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 855/1698] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:42.888193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:42.905966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0973ca9-d6da-4fb8-9b2e-df9041ae0a41 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:42.914526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76594b5d-8b71-433b-b6c9-f59e8e007dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:42.915510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594b5d-8b71-433b-b6c9-f59e8e007dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.915795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594b5d-8b71-433b-b6c9-f59e8e007dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.916772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76594b5d-8b71-433b-b6c9-f59e8e007dba admin admin] PATH_INFO: `/v3/projects/e6898ee837a941979dc40c4ba7781181/users/33b295b0cb0146fdaf782c77d20d7354/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.921213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594b5d-8b71-433b-b6c9-f59e8e007dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6898ee837a941979dc40c4ba7781181, user_id=33b295b0cb0146fdaf782c77d20d7354, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:42.924226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76594b5d-8b71-433b-b6c9-f59e8e007dba admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:42.928374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec748-76b0-4af6-b129-b4c7d517311a None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.929821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec748-76b0-4af6-b129-b4c7d517311a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.929961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ec748-76b0-4af6-b129-b4c7d517311a None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.933187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 856/1699] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 09:57:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:57:42.943462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.944162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.944680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:42.987946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 844/1700] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:42 2022] PUT /identity/v3/projects/e6898ee837a941979dc40c4ba7781181/users/33b295b0cb0146fdaf782c77d20d7354/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:42.992221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:42.992855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:42.992855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:43.062066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:43.064786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:43.068339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] MFA Rules not processed for user `33b295b0cb0146fdaf782c77d20d7354`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:43.070517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:43.095620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:43.238114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 857/1701] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:57:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:57:43.298670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:43.300411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:43.316970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 845/1702] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:43.325118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc5bcb-1800-49fd-be92-6276390541a2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:43.329347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:43.331794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:43.350953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:43.350953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:43.351633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:43.391370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:43.392853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:43.416187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 858/1703] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:43.534553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8c4d9-927a-4b16-9e8e-c4087e095ba4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:43.546867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c0770-dd1e-4bfe-9253-14256752ba9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:43.547974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c0770-dd1e-4bfe-9253-14256752ba9c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:43.548679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c0770-dd1e-4bfe-9253-14256752ba9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:43.549051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c0770-dd1e-4bfe-9253-14256752ba9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:43.574189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c0770-dd1e-4bfe-9253-14256752ba9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:43.578917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c0770-dd1e-4bfe-9253-14256752ba9c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:43.628894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 846/1704] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:43.989986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:44.016787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:44.209132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83e77-ff9d-4d05-90ce-c294ab3a8527 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:44.235341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:44.237673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:44.237970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:44.238330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] PATH_INFO: `/v3/users/4222bfaf62ba4082901cf564c01fed56` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:44.246527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4222bfaf62ba4082901cf564c01fed56)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:44.251478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:44.446053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4222bfaf62ba4082901cf564c01fed56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:44.507582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4222bfaf62ba4082901cf564c01fed56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:44.537831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4222bfaf62ba4082901cf564c01fed56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:44.572596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4222bfaf62ba4082901cf564c01fed56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:44.575936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4222bfaf62ba4082901cf564c01fed56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:44.605564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 859/1705] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:43 2022] DELETE /identity/v3/users/4222bfaf62ba4082901cf564c01fed56 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:44.611083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4de20-7cff-468b-bacd-04164fbd88d3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:44.611627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4de20-7cff-468b-bacd-04164fbd88d3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:44.611627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4de20-7cff-468b-bacd-04164fbd88d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:44.645146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dbe4de20-7cff-468b-bacd-04164fbd88d3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:44.646315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dbe4de20-7cff-468b-bacd-04164fbd88d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:44.773591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 847/1706] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:44.787583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:44.789742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:44.979736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbeefe6-0205-497e-a721-48f5b5bc0189 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:44.994664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01034cf-6224-435c-8b52-7820c08f8adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:44.998984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01034cf-6224-435c-8b52-7820c08f8adb service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:44.999145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01034cf-6224-435c-8b52-7820c08f8adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:45.000545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01034cf-6224-435c-8b52-7820c08f8adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:45.031413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01034cf-6224-435c-8b52-7820c08f8adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:45.032879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01034cf-6224-435c-8b52-7820c08f8adb service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:45.045016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 860/1707] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:45.083271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb41cb-5fb1-4020-9f4c-a197182f1e78 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:45.083769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb41cb-5fb1-4020-9f4c-a197182f1e78 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:45.084151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb41cb-5fb1-4020-9f4c-a197182f1e78 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:45.085956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 848/1708] 10.222.0.17 () {54 vars in 960 bytes} [Wed Jul 13 09:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:57:45.103881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:45.113575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:45.114191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:45.157500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:45.159359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:45.264135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:45.331944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb41cb-5fb1-4020-9f4c-a197182f1e78 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:45.333768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fbeb41cb-5fb1-4020-9f4c-a197182f1e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:45.380935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 861/1709] 10.222.0.17 () {58 vars in 1057 bytes} [Wed Jul 13 09:57:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:45.394531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:45.409568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d60e72-16a6-4e47-90fb-1f1e9f04db58 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:45.409702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb41cb-5fb1-4020-9f4c-a197182f1e78 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:45.426974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:45.428060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:45.428738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:45.428893 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:45.429498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:45.430106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:45.432983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:45.434030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] PATH_INFO: `/v3/users/8f187472c6934541ac7ae3bb72464e6d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:45.440921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f187472c6934541ac7ae3bb72464e6d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:45.442118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:45.444453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:45.468079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:45.474308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53350c5b-bb74-4215-bcc6-f658a9fee78f service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:45.510141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 862/1710] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:45.575646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:45.587464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f187472c6934541ac7ae3bb72464e6d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:45.639844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f187472c6934541ac7ae3bb72464e6d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:45.672213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f187472c6934541ac7ae3bb72464e6d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:45.673024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f187472c6934541ac7ae3bb72464e6d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:45.686830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f187472c6934541ac7ae3bb72464e6d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:45.713498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 849/1711] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:45 2022] DELETE /identity/v3/users/8f187472c6934541ac7ae3bb72464e6d => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:57:45.716462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:45.716878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:45.717259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:45.777727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:45.782403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:45.979054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:45.979054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:45.993811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 863/1712] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:57:46.067083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:46.068651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:46.219932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f0e22d-e416-47c0-9a7a-b4666c711364 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:46.237105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:46.240413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:46.241806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:46.242330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] PATH_INFO: `/v3/users/bfbcffa386b54c0fb96f588a2da1dd05` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:46.247468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfbcffa386b54c0fb96f588a2da1dd05)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:46.254044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:46.295493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006cb3a-d20b-47ee-8b80-20a60a681bc7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:46.312009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f84d5e-e63f-4704-92d1-d94901f61643 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:46.315309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f84d5e-e63f-4704-92d1-d94901f61643 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:46.323027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f84d5e-e63f-4704-92d1-d94901f61643 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:46.324369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f84d5e-e63f-4704-92d1-d94901f61643 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:46.362632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f84d5e-e63f-4704-92d1-d94901f61643 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:46.382300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f84d5e-e63f-4704-92d1-d94901f61643 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:46.403677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 864/1713] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:46.436656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:46.436984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:46.437264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:46.452942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfbcffa386b54c0fb96f588a2da1dd05'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:46.488991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfbcffa386b54c0fb96f588a2da1dd05'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:46.518274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfbcffa386b54c0fb96f588a2da1dd05'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:46.519195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfbcffa386b54c0fb96f588a2da1dd05'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:46.531474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] MFA Rules not processed for user `53afa795849e439b8497b9f388d5735e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:46.532634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:46.549965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-695a031c-3d40-4d6f-8b4a-058ca1d19e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfbcffa386b54c0fb96f588a2da1dd05'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:46.570640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 850/1714] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:45 2022] DELETE /identity/v3/users/bfbcffa386b54c0fb96f588a2da1dd05 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:46.573348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:46.575279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:46.576180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:46.618195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:46.632909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:46.717959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:46.774675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:46.804270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 865/1715] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:46.823021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:46.824568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:46.835340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 851/1716] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:46.894809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:46.897560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:47.016196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b169f-7527-4aa3-9c05-38f1720f1b4c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:47.039285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f871491-95a7-4997-9b61-5b85f9a52066 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:47.043752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:47.044484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:47.044881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:47.045161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:47.056677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:47.058730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:47.074672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 852/1717] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:47.076990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:47.079296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:47.110083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd2f5e8-38e7-47fe-97a3-e7bf82e64b74 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:47.116365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:47.117393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:47.117962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:47.118065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] PATH_INFO: `/v3/projects/939f03d48c5f45b893f7ff82b3bb27e2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:47.119706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] RBAC: Authorizing `identity:delete_project(project_id=939f03d48c5f45b893f7ff82b3bb27e2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:47.121757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:47.205033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e121ec-b4dc-4a66-9187-26e75ba41e07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:47.206076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e121ec-b4dc-4a66-9187-26e75ba41e07 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:47.206659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e121ec-b4dc-4a66-9187-26e75ba41e07 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:47.207205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e121ec-b4dc-4a66-9187-26e75ba41e07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:47.232098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939f03d48c5f45b893f7ff82b3bb27e2', 'request_id': 'req-03aec2f1-c485-48ec-8488-bac5a00ca60c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.249480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939f03d48c5f45b893f7ff82b3bb27e2', 'request_id': 'req-03aec2f1-c485-48ec-8488-bac5a00ca60c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.262996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939f03d48c5f45b893f7ff82b3bb27e2', 'request_id': 'req-03aec2f1-c485-48ec-8488-bac5a00ca60c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.275921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e121ec-b4dc-4a66-9187-26e75ba41e07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:47.278234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e121ec-b4dc-4a66-9187-26e75ba41e07 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:47.284501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] The token cache is being invalidate because project 939f03d48c5f45b893f7ff82b3bb27e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:47.284844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.285823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.288919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 853/1718] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:47 2022] DELETE /identity/v3/projects/939f03d48c5f45b893f7ff82b3bb27e2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:47.294192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:47.297206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:47.306897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 866/1719] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:47.497071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aec2f1-c485-48ec-8488-bac5a00ca60c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:47.507314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:47.509452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:47.512565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:47.512975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] PATH_INFO: `/v3/users/33b295b0cb0146fdaf782c77d20d7354` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:47.515604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33b295b0cb0146fdaf782c77d20d7354)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:47.524039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:47.543064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:47.617731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33b295b0cb0146fdaf782c77d20d7354'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.636596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33b295b0cb0146fdaf782c77d20d7354'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.652170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33b295b0cb0146fdaf782c77d20d7354'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.652934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33b295b0cb0146fdaf782c77d20d7354'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.671509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33b295b0cb0146fdaf782c77d20d7354'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:47.694005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 854/1720] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:47 2022] DELETE /identity/v3/users/33b295b0cb0146fdaf782c77d20d7354 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:48.054925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:48.054925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:48.054925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:48.219345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] MFA Rules not processed for user `c5ef575152d54c92af80295e1f89603d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:48.220599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:48.242318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:48.243921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:48.259354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:48.438900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 867/1721] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:48.455384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:48.457268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:48.465773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43deda1-eb5d-4d95-9e06-727a36c4f4a4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:48.472252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:48.473407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:48.473932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:48.474309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] PATH_INFO: `/v3/projects/e21afcc281bc4fbb9841757e428ca003` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:48.476755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=e21afcc281bc4fbb9841757e428ca003)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:48.479429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:48.613954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e21afcc281bc4fbb9841757e428ca003', 'request_id': 'req-026cbe90-8346-4139-8c5c-e01ba1da46bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:48.622000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e21afcc281bc4fbb9841757e428ca003', 'request_id': 'req-026cbe90-8346-4139-8c5c-e01ba1da46bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:48.645479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e21afcc281bc4fbb9841757e428ca003', 'request_id': 'req-026cbe90-8346-4139-8c5c-e01ba1da46bf'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:48.682940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c4fc2-fa9f-4ea5-86ea-1ed90596b484 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:48.697005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] The token cache is being invalidate because project e21afcc281bc4fbb9841757e428ca003 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:48.697219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:48.704791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:48.712560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 855/1722] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:48 2022] DELETE /identity/v3/projects/e21afcc281bc4fbb9841757e428ca003 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:57:48.713944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:48.719066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:48.796520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:48.827109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:48.828259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:48.828822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:48.829250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:48.831852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:48.949677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026cbe90-8346-4139-8c5c-e01ba1da46bf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:48.956264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:48.957490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:48.957884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:48.958392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] PATH_INFO: `/v3/users/45d3abf90dc043a4881f1d4a83252ace` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:48.960124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d3abf90dc043a4881f1d4a83252ace)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:48.964017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:48.987894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:49.031774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:49.033593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bd90a-05ee-4f43-a7a1-e268cd753ed0 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:49.075176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d3abf90dc043a4881f1d4a83252ace'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:49.086894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 868/1723] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:57:49.102527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d3abf90dc043a4881f1d4a83252ace'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:49.122316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d3abf90dc043a4881f1d4a83252ace'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:49.126243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d3abf90dc043a4881f1d4a83252ace'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:49.139165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5c615407-9ddf-492d-b159-658a57f50629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d3abf90dc043a4881f1d4a83252ace'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:49.148550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 856/1724] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:57:48 2022] DELETE /identity/v3/users/45d3abf90dc043a4881f1d4a83252ace => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:49.279766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:49.280061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:49.280342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:49.383342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:49.384563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:49.426337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:49.427386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:49.428099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:49.497839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] MFA Rules not processed for user `33dd51cac73b4712a8d0f4df9bfd0dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:49.500931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:49.557596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 869/1725] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:57:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:49.610790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:49.617815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:49.716337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 857/1726] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:49.725931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:49.736099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:49.819938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:49.836150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ccea0-44f8-4b8e-ba55-22078a46a16b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:49.857132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:49.859764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:49.860069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:49.860971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] PATH_INFO: `/v3/projects/2c86391ccd254aa09dbb9b303085f466` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:49.865156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c86391ccd254aa09dbb9b303085f466)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:49.869407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:49.911718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf482-27ff-414a-a066-4dbac273fb87 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:49.928585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:49.930800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:49.931654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:49.931654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:49.944323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:49.952329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:49.970162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 858/1727] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:49.971558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:49.973509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.014077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c86391ccd254aa09dbb9b303085f466', 'request_id': 'req-98df3485-ac04-43f4-866e-9235e5241fb7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.031963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c86391ccd254aa09dbb9b303085f466', 'request_id': 'req-98df3485-ac04-43f4-866e-9235e5241fb7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.064693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c86391ccd254aa09dbb9b303085f466', 'request_id': 'req-98df3485-ac04-43f4-866e-9235e5241fb7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.067576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:50.088383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] The token cache is being invalidate because project 2c86391ccd254aa09dbb9b303085f466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:50.090475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.094351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.096158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 870/1728] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:49 2022] DELETE /identity/v3/projects/2c86391ccd254aa09dbb9b303085f466 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:50.097007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:50.108554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.298108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df3485-ac04-43f4-866e-9235e5241fb7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:50.301054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c756e-51be-41ec-a511-5d61103c80da service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:50.303725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:50.304979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:50.305418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:50.305835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] PATH_INFO: `/v3/projects/e6898ee837a941979dc40c4ba7781181` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:50.307338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6898ee837a941979dc40c4ba7781181)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:50.310217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:50.399623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6898ee837a941979dc40c4ba7781181', 'request_id': 'req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.410731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:50.412556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:50.412887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:50.414151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6898ee837a941979dc40c4ba7781181', 'request_id': 'req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.426743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6898ee837a941979dc40c4ba7781181', 'request_id': 'req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.428603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:50.435139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.442244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] The token cache is being invalidate because project e6898ee837a941979dc40c4ba7781181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:50.442783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.443528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-63f5b63a-d68f-411d-ab4a-74a1bad0f3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.448997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 871/1729] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:50 2022] DELETE /identity/v3/projects/e6898ee837a941979dc40c4ba7781181 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:50.451817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5405-6030-4209-aaf7-29504d6d5f21 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:50.452277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5405-6030-4209-aaf7-29504d6d5f21 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:50.452774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5405-6030-4209-aaf7-29504d6d5f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:50.500431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0bbe5405-6030-4209-aaf7-29504d6d5f21 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:50.504143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0bbe5405-6030-4209-aaf7-29504d6d5f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.512266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:50.584552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:50.587004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:50.600775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 859/1730] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 09:57:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:57:50.601754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:50.605269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.695498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 872/1731] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:50.696835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c0b81-e9f5-4253-a974-49d141d25cb1 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:50.700248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78465a0-9c9e-4e51-8a65-f6c0de0b5568 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:50.701445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78465a0-9c9e-4e51-8a65-f6c0de0b5568 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:50.705006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78465a0-9c9e-4e51-8a65-f6c0de0b5568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:50.731518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:50.733351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:50.733467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:50.733835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] PATH_INFO: `/v3/projects/e63c866b15ba4617adb80d7ad2d96af2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:50.735891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e63c866b15ba4617adb80d7ad2d96af2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:50.739604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:50.769343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d78465a0-9c9e-4e51-8a65-f6c0de0b5568 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:50.771169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d78465a0-9c9e-4e51-8a65-f6c0de0b5568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.802796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 873/1732] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:50.808415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311b9d-9aa0-471b-9414-0b75a5d7ad7a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:50.808928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311b9d-9aa0-471b-9414-0b75a5d7ad7a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:50.811076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c311b9d-9aa0-471b-9414-0b75a5d7ad7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:50.862627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4c311b9d-9aa0-471b-9414-0b75a5d7ad7a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:50.866643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4c311b9d-9aa0-471b-9414-0b75a5d7ad7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:50.886860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:50.906883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e63c866b15ba4617adb80d7ad2d96af2', 'request_id': 'req-d851d5a6-496f-472d-bcf8-909d0aa4930f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.942780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e63c866b15ba4617adb80d7ad2d96af2', 'request_id': 'req-d851d5a6-496f-472d-bcf8-909d0aa4930f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:50.963402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e63c866b15ba4617adb80d7ad2d96af2', 'request_id': 'req-d851d5a6-496f-472d-bcf8-909d0aa4930f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:51.028311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] The token cache is being invalidate because project e63c866b15ba4617adb80d7ad2d96af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:57:51.028696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:51.029418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d851d5a6-496f-472d-bcf8-909d0aa4930f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:57:51.036504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 860/1733] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:57:50 2022] DELETE /identity/v3/projects/e63c866b15ba4617adb80d7ad2d96af2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:51.038455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.038778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.039599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.061461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 874/1734] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:51.066355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.066355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.068074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.092586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:51.095480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:51.102243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:51.103424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:51.115302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 861/1735] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:51.116363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.127905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 875/1736] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:51.136126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.150191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963c05b-151d-44f7-a39f-e91662fc4bea None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.172464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d2340-976c-4701-bede-65bf2aa3d31a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.183053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.183053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.183053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.183053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.185650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:51.185650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.187324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77222-2530-45b6-a234-24cff2dc46b9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:51.191432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.193604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.200541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.203624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.204549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:51.207800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.211027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:51.213860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 876/1737] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:51.232090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.232413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.232794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.259496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:51.260819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:51.275900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 877/1738] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:51.280284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.282850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 862/1739] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:51.285317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.305865 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9415a55-1578-4dc6-9afc-4b233e8a96cd None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.321497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.322200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.322487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.322765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.323862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.325796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:51.326223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dced6-12f5-41c5-b8e6-f1fe2e789534 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.344335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.345026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.353350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.355230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.360988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:57:51.362268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.369201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:51.393894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 878/1740] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/projects => generated 405 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:51.400379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.438352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 863/1741] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:57:51.439239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.502676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f24dd7a-8bc1-42c2-8e20-3504c4a61325 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.624590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162c4009-b803-408f-9cf1-92b6381a89e3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.637379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.638829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.638829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.639116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.640411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.645570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:51.718699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 879/1742] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/projects => generated 363 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:51.719780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.815250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.815951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.816229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.816499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.817196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.819397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:51.914172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 864/1743] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/users => generated 303 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:51.914172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:51.927808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:51.961376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cca505c-5466-4d39-a4d0-8c4241e04dd4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.978712 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d172a63-9002-4334-a109-ae37a640ee2f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:51.979327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:51.980026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:51.980308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:51.980580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:51.988061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:51.997446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.001227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.003683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.005403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.005869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.009143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.013643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.038405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:52.083592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 865/1744] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:52.084279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.141185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075457-e898-4f13-ab2c-e3ce43bdaf9c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.161340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.162060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.164726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.165005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.165909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.174115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.209144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 880/1745] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:51 2022] POST /identity/v3/projects => generated 367 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:52.220124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.232910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 866/1746] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:52.238023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.282986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d2efa-7fd0-4dc2-a208-177148857487 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.555120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12707df3-0e86-4244-a4b8-9a8f5aa5d156 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.561304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.561995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.562275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.562585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.575112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.575112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.579345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.584305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.586124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.587208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.593896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.602499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.644052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 867/1747] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:52 2022] POST /identity/v3/users => generated 284 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:52.651450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.708162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 881/1748] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:52.708162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.710899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae01738a-ad70-44ef-af8c-dfc2d15a5af7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.733112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c7b9d-ba4b-4cd8-803e-6f4286ec3971 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.735018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.735726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.736015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.736296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.737046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.745876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.754117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.755704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.757617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.759318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.760833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.767351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.805066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 868/1749] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:52.817318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.840097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 882/1750] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:52.848389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.886288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c0a84-5f72-47b4-9370-7c9befb42951 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.911715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293d6fab-16b6-4977-8784-432fef660923 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:52.916636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.917339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.917624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.917902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.918676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:52.923152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:52.931804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:52.935056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:52.935434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:52.939799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] PATH_INFO: `/v3/projects/023683ceccc44b7b9fabf4e5e14ab3a1/users/48f8547f34bf412b97e329eb45ee7b3d/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:52.956558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 869/1751] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:52.956558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:52.995056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430b3c-5eb8-4b89-abf8-39cc2d6a06b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:53.009831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:53.011371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023683ceccc44b7b9fabf4e5e14ab3a1, user_id=48f8547f34bf412b97e329eb45ee7b3d, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:53.012131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:53.014808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:53.015442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:53.016367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:53.017550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:53.017923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:53.081433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 870/1752] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:52 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:53.087612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:53.103812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 883/1753] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:52 2022] PUT /identity/v3/projects/023683ceccc44b7b9fabf4e5e14ab3a1/users/48f8547f34bf412b97e329eb45ee7b3d/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:53.105421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:53.135210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596c26c-9bc7-4325-8e92-f4e3a4c02c92 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:53.426792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d825e-17b8-4bfc-ad16-f0d090121e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:53.435426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d825e-17b8-4bfc-ad16-f0d090121e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:53.435878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d825e-17b8-4bfc-ad16-f0d090121e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:53.441299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d825e-17b8-4bfc-ad16-f0d090121e5a admin admin] PATH_INFO: `/v3/projects/2e1c24f91aa3487ea22ee971a05a2b9f/users/3559f16f5ca241d097b5cc2ffe0ce5c8/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:53.527795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc341e-e3d0-4908-9d87-b0a263362a12 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:53.542820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d825e-17b8-4bfc-ad16-f0d090121e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e1c24f91aa3487ea22ee971a05a2b9f, user_id=3559f16f5ca241d097b5cc2ffe0ce5c8, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:53.548594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d825e-17b8-4bfc-ad16-f0d090121e5a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:53.556329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12589f07-8352-42cc-83c2-052ffd79b921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:53.557536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12589f07-8352-42cc-83c2-052ffd79b921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:53.557648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12589f07-8352-42cc-83c2-052ffd79b921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:53.557929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12589f07-8352-42cc-83c2-052ffd79b921 admin admin] PATH_INFO: `/v3/projects/ce069086fb004f4595ec2fe264ac4d1e/users/414e11ace58d411ca2dfd67a67ca62a7/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:53.580687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 871/1754] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:53 2022] PUT /identity/v3/projects/2e1c24f91aa3487ea22ee971a05a2b9f/users/3559f16f5ca241d097b5cc2ffe0ce5c8/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:53.582731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1c1aa-5d53-43ff-8fd3-279361bd3e7c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:53.583233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1c1aa-5d53-43ff-8fd3-279361bd3e7c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:53.583767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb1c1aa-5d53-43ff-8fd3-279361bd3e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:53.627720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dfb1c1aa-5d53-43ff-8fd3-279361bd3e7c None None] MFA Rules not processed for user `48f8547f34bf412b97e329eb45ee7b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:53.628684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12589f07-8352-42cc-83c2-052ffd79b921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce069086fb004f4595ec2fe264ac4d1e, user_id=414e11ace58d411ca2dfd67a67ca62a7, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:53.629727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dfb1c1aa-5d53-43ff-8fd3-279361bd3e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:53.641280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12589f07-8352-42cc-83c2-052ffd79b921 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:53.652163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:53.716909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 884/1755] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:53 2022] PUT /identity/v3/projects/ce069086fb004f4595ec2fe264ac4d1e/users/414e11ace58d411ca2dfd67a67ca62a7/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:53.724123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:53.724405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:53.724682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:53.795041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 872/1756] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:53.801191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:53.801745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:53.802229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:53.879860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] MFA Rules not processed for user `414e11ace58d411ca2dfd67a67ca62a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:53.881262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:53.881622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] MFA Rules not processed for user `3559f16f5ca241d097b5cc2ffe0ce5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:53.882835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:53.945105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:54.087261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 873/1757] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:54.088468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:54.226835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 885/1758] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:53 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:54.226835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:54.355189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c971852-2d7d-40a9-abd5-0ec0c517e3ec None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:54.379230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:54.382727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:54.384808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:54.385928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:54.388302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:54.398103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:54.456642 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ca17a-e6f2-4e47-8b87-15cb41603de8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:54.486237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895013e-00eb-4316-9f61-7ac55f76b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:54.487522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895013e-00eb-4316-9f61-7ac55f76b06c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:54.489349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895013e-00eb-4316-9f61-7ac55f76b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:54.490643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895013e-00eb-4316-9f61-7ac55f76b06c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:54.495997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895013e-00eb-4316-9f61-7ac55f76b06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:54.509592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895013e-00eb-4316-9f61-7ac55f76b06c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:54.512201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 874/1759] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:54 2022] POST /identity/v3/projects => generated 409 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:54.518694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:54.620241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 886/1760] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:54 2022] POST /identity/v3/projects => generated 369 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:54.633630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:54.635506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:54.637059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:54.682148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:54.736466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:54.737791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:54.847940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0509902-9c95-4334-9d9d-2f2d624a6712 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.021458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 887/1761] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Jul 13 09:57:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:55.036334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.175192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.175883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.176231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.176508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.177610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.185764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:55.187037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.209315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e385952-3290-4b0e-b354-73fc239339b3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.214580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.215756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.216256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.216739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.217904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.220239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.246703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 888/1762] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:55 2022] POST /identity/v3/users => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:55.248321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.261137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b747b-80e8-4334-871d-d728ebf6b536 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.268533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.269684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.270220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.270838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.272095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.275032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.276991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 875/1763] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:57:54 2022] POST /identity/v3/projects => generated 365 bytes in 759 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:55.278094 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.284330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:55.321167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 889/1764] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:55 2022] POST /identity/v3/users => generated 291 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:55.322800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.346995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d5de05-c4f1-4e70-b56e-003a5ed45398 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.551840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42777b3e-5b42-4be0-9743-fb9f34a372e0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.563952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.566442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.566774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.567031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.599225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.600566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.600954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.601417 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.602610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.605836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.606834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.608331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.629955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 876/1765] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:55.630862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.658198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a0b85a-8f28-4b2f-95a3-253ec9bd0a62 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.672197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33949e2-e1d7-4e5b-ad58-e20f57fbfb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.675247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33949e2-e1d7-4e5b-ad58-e20f57fbfb02 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.676850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33949e2-e1d7-4e5b-ad58-e20f57fbfb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.677991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33949e2-e1d7-4e5b-ad58-e20f57fbfb02 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.679237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33949e2-e1d7-4e5b-ad58-e20f57fbfb02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.685656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33949e2-e1d7-4e5b-ad58-e20f57fbfb02 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.688789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 890/1766] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:55.690960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.724539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24180580-4667-47e6-8239-7995cb3d012c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.753822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.754512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.758664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.759001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.762283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 877/1767] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:57:55 2022] POST /identity/v3/users => generated 289 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:57:55.772261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.773973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.774693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.775227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.795165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.825649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 891/1768] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:55.826802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:55.835322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] MFA Rules not processed for user `53afa795849e439b8497b9f388d5735e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:55.839819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:55.844512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be82c1-8cf7-4c8b-b005-4afda1581a79 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:55.851141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:55.852408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:55.852795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:55.853133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] PATH_INFO: `/v3/projects/550aa9fa880544a5be8ce242f407c03d/users/9fcd4e1340f044ab8ad455274233be70/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:55.888898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=550aa9fa880544a5be8ce242f407c03d, user_id=9fcd4e1340f044ab8ad455274233be70, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:55.897799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:55.936441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 892/1769] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:55 2022] PUT /identity/v3/projects/550aa9fa880544a5be8ce242f407c03d/users/9fcd4e1340f044ab8ad455274233be70/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:55.937504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:56.103611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:56.209402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 878/1770] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 446 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:56.214515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:56.271859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3c979-dd91-4bda-97e0-02f98c357fd2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:56.291516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:56.292758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:56.296827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:56.297943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] PATH_INFO: `/v3/projects/d3acef0c7a9544189368b7f8ac56bb28/users/e752954e6ec04090bf81849c84925259/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:56.311362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd07acc-60c4-4dbe-906b-040b0942c8b7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:56.340000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:56.340765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:56.341077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:56.341353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:56.342155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:56.344910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:56.405800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3acef0c7a9544189368b7f8ac56bb28, user_id=e752954e6ec04090bf81849c84925259, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:56.408574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:56.449188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 893/1771] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:55 2022] GET /identity/v3/roles => generated 1420 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:56.450697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:56.481131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 879/1772] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:56 2022] PUT /identity/v3/projects/d3acef0c7a9544189368b7f8ac56bb28/users/e752954e6ec04090bf81849c84925259/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:56.481979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:56.513287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02a49a-546c-4c9e-bd53-f0bcebe517ec admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:56.572706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:56.746236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:56.747326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:56.747615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:56.747895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:56.748683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:56.750389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:56.781281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 894/1773] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:56.792355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:56.826714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c3639c-45fd-4171-bd8f-4d900c50e6de admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:56.840735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:56.841441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:56.841767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:56.842022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:56.843846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:56.845578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:56.876674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 895/1774] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:56.880276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:56.901125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf775faf-5c8b-4705-8df4-6f25e5dc98b5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:56.912255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490ce8c-d365-413b-94bc-f03494440729 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:56.929683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c895c0f-5b27-47e0-b87e-b1cc7f81d0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:56.934652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895c0f-5b27-47e0-b87e-b1cc7f81d0fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:56.935012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895c0f-5b27-47e0-b87e-b1cc7f81d0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:56.938288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c895c0f-5b27-47e0-b87e-b1cc7f81d0fe admin admin] PATH_INFO: `/v3/projects/415c3149f1bf48218de18b4d4c13642b/users/f1889d5210cb48269bde97cabc472a70/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:56.939145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:56.940218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:56.940525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:56.940791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] PATH_INFO: `/v3/projects/550aa9fa880544a5be8ce242f407c03d/users/9fcd4e1340f044ab8ad455274233be70/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:56.949124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=550aa9fa880544a5be8ce242f407c03d, user_id=9fcd4e1340f044ab8ad455274233be70, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:56.952996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:57.012521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c895c0f-5b27-47e0-b87e-b1cc7f81d0fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=415c3149f1bf48218de18b4d4c13642b, user_id=f1889d5210cb48269bde97cabc472a70, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:57.017935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 896/1775] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:56 2022] PUT /identity/v3/projects/550aa9fa880544a5be8ce242f407c03d/users/9fcd4e1340f044ab8ad455274233be70/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:57.018670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:57.026142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c895c0f-5b27-47e0-b87e-b1cc7f81d0fe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:57.082833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 880/1776] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:56 2022] PUT /identity/v3/projects/415c3149f1bf48218de18b4d4c13642b/users/f1889d5210cb48269bde97cabc472a70/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:57.082833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:57.082833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:57.086656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:57.179085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] MFA Rules not processed for user `9fcd4e1340f044ab8ad455274233be70`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:57.180463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:57.289497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae5bc9-9a3d-42b5-bf82-79cbe11832cd admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:57.416409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 881/1777] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:57 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:57.417310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:57.528368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:57.536663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:57.537237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:57.537755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] PATH_INFO: `/v3/projects/d3acef0c7a9544189368b7f8ac56bb28/users/e752954e6ec04090bf81849c84925259/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:57.544881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3acef0c7a9544189368b7f8ac56bb28, user_id=e752954e6ec04090bf81849c84925259, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:57.548751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:57.594104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 897/1778] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:57 2022] PUT /identity/v3/projects/d3acef0c7a9544189368b7f8ac56bb28/users/e752954e6ec04090bf81849c84925259/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:57.594104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:57.610987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:57.613249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:57.708570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:57.729002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ead24-7f90-43d2-9920-83a53ffb710a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:57.789495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f38f2-02fe-4fb7-996d-1f708c1042c4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:57.800432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe3aa0-25ef-4908-969e-b44916d4330c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:57.802051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe3aa0-25ef-4908-969e-b44916d4330c service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:57.802577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe3aa0-25ef-4908-969e-b44916d4330c service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:57.804177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe3aa0-25ef-4908-969e-b44916d4330c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:57.969344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe3aa0-25ef-4908-969e-b44916d4330c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:57.974770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe3aa0-25ef-4908-969e-b44916d4330c service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:58.004419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 898/1779] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:57 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:58.007978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.009724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.010251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:58.026672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4ba24a-5cfb-45a8-8c6e-a23a71574f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:58.029552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba24a-5cfb-45a8-8c6e-a23a71574f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.031659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba24a-5cfb-45a8-8c6e-a23a71574f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.032281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4ba24a-5cfb-45a8-8c6e-a23a71574f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:58.033882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ba24a-5cfb-45a8-8c6e-a23a71574f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:58.037004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4ba24a-5cfb-45a8-8c6e-a23a71574f86 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:58.051019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] MFA Rules not processed for user `c5ef575152d54c92af80295e1f89603d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:58.052952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:58.078987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 882/1780] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 662 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:57:58.080776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.083630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.086386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:58.221223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] MFA Rules not processed for user `e752954e6ec04090bf81849c84925259`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:58.226191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:58.310695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 899/1781] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:58.313457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:58.362645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c638f7-aa9e-4904-a1d5-fc174f445912 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:58.393854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d4f66-950d-44da-bf71-d07f1927bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:58.396809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4f66-950d-44da-bf71-d07f1927bcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.398931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4f66-950d-44da-bf71-d07f1927bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.399163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d4f66-950d-44da-bf71-d07f1927bcfb admin admin] PATH_INFO: `/v3/projects/415c3149f1bf48218de18b4d4c13642b/users/f1889d5210cb48269bde97cabc472a70/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:58.415192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d4f66-950d-44da-bf71-d07f1927bcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=415c3149f1bf48218de18b4d4c13642b, user_id=f1889d5210cb48269bde97cabc472a70, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:58.432709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d4f66-950d-44da-bf71-d07f1927bcfb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:58.504759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 900/1782] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:57:58 2022] PUT /identity/v3/projects/415c3149f1bf48218de18b4d4c13642b/users/f1889d5210cb48269bde97cabc472a70/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:57:58.521948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.522389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.523173 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:58.564100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 883/1783] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:58.577403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:58.582369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:58.622764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5e40b1-1c02-43b2-a04e-2a1e7a8e6aab None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:58.623410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] MFA Rules not processed for user `f1889d5210cb48269bde97cabc472a70`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:57:58.626471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:57:58.792297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:58.794656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.796737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.797910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:58.839704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:58.853789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:57:58.886869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 901/1784] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:57:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:57:58.889301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:58.921732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8427160-8c9f-4981-8859-36a5e90ee5cc None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:58.937021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:58.941505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:58.941900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:58.942911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:59.013602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:59.022124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:59.062116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 884/1785] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:58 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:59.113854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:59.115984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:59.138367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 902/1786] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:58 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:59.181515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:59.191275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca43c00-d0d7-4e38-82fc-e4e9acd59d89 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:59.205449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c23d82-2cdf-487b-8b75-2023bd8259b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:59.210645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c23d82-2cdf-487b-8b75-2023bd8259b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:59.211032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c23d82-2cdf-487b-8b75-2023bd8259b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:59.211327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c23d82-2cdf-487b-8b75-2023bd8259b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:59.241766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c23d82-2cdf-487b-8b75-2023bd8259b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:59.243504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c23d82-2cdf-487b-8b75-2023bd8259b7 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:59.295673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 885/1787] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:57:59.395800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:57:59.409229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76ab8b3-0f68-4592-8695-4fefcc6f70e1 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:57:59.457277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987f0d-1971-4d00-8869-cd4f69a30603 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:57:59.467957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987f0d-1971-4d00-8869-cd4f69a30603 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:57:59.474948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987f0d-1971-4d00-8869-cd4f69a30603 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:57:59.475378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987f0d-1971-4d00-8869-cd4f69a30603 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:57:59.755437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07987f0d-1971-4d00-8869-cd4f69a30603 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:57:59.759185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07987f0d-1971-4d00-8869-cd4f69a30603 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:57:59.838766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 903/1788] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:57:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:01.405274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad6f41-1d07-45c4-b4a9-7506d97081b5 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:01.406340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad6f41-1d07-45c4-b4a9-7506d97081b5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:01.406842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ad6f41-1d07-45c4-b4a9-7506d97081b5 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:01.408872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 886/1789] 10.222.0.17 () {54 vars in 912 bytes} [Wed Jul 13 09:58:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:58:01.425261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e05c-65e8-4839-8611-40a1041b37e2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:01.425874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e05c-65e8-4839-8611-40a1041b37e2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:01.426463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e05c-65e8-4839-8611-40a1041b37e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:01.517629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-db63e05c-65e8-4839-8611-40a1041b37e2 None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:01.520952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-db63e05c-65e8-4839-8611-40a1041b37e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:01.734785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 904/1790] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:58:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:01.800931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad6f41-1d07-45c4-b4a9-7506d97081b5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:01.941501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ad6f41-1d07-45c4-b4a9-7506d97081b5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:01.948499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:01.949683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:01.951465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329826e-7d7a-4ab1-9679-da9c50f6b000 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:01.951913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329826e-7d7a-4ab1-9679-da9c50f6b000 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:01.953195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d329826e-7d7a-4ab1-9679-da9c50f6b000 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:01.955497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 905/1791] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:58:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 13 09:58:01.955649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:01.955649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] PATH_INFO: `/v3/users/3559f16f5ca241d097b5cc2ffe0ce5c8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:01.956725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3559f16f5ca241d097b5cc2ffe0ce5c8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:01.958906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:02.087287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3559f16f5ca241d097b5cc2ffe0ce5c8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:02.116448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3559f16f5ca241d097b5cc2ffe0ce5c8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:02.125259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3559f16f5ca241d097b5cc2ffe0ce5c8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:02.125951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3559f16f5ca241d097b5cc2ffe0ce5c8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:02.135868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-5909aa91-2486-4569-80c4-38e8cc5a1e66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3559f16f5ca241d097b5cc2ffe0ce5c8'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:02.147354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 887/1792] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:01 2022] DELETE /identity/v3/users/3559f16f5ca241d097b5cc2ffe0ce5c8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:02.149172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec9c2-9e35-4c08-b2bc-b479f8854ee1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:02.150231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec9c2-9e35-4c08-b2bc-b479f8854ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:02.150866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bec9c2-9e35-4c08-b2bc-b479f8854ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:02.185838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b4bec9c2-9e35-4c08-b2bc-b479f8854ee1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:02.191421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b4bec9c2-9e35-4c08-b2bc-b479f8854ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:02.204002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:02.204002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:02.204002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:02.253734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:02.257470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:02.282809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:02.284957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:02.348067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 906/1793] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:02.350477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:02.350868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:02.351384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:02.394078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] MFA Rules not processed for user `33dd51cac73b4712a8d0f4df9bfd0dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:02.396676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 888/1794] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:02.397675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:02.400039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:02.401220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:02.496525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 907/1795] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:02.499228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:02.516766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cc70e-b863-4190-bb5b-0ec657eb6216 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:02.522149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dfc31e-7e3b-4eb4-adb4-93665218729c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:02.523440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:02.524431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:02.524813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:02.525333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:02.527277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:02.527946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:02.528121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:02.528410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:02.528692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:02.543672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:02.545631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:02.547587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:02.549388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:02.569156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 908/1796] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:02.570123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:02.571722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:02.580071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 889/1797] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:02.633151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee9f31-2dfd-4ae6-971c-993011a27a67 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:02.657379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:02.657379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:02.657379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:02.657379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:02.674719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:02.676689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:02.695504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 909/1798] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:03.589187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:03.590821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:03.620287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93eab89-c0e2-4481-9f32-3b13c8dcd834 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:03.627827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:03.628734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:03.629020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:03.629287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] PATH_INFO: `/v3/projects/2e1c24f91aa3487ea22ee971a05a2b9f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:03.630512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e1c24f91aa3487ea22ee971a05a2b9f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:03.633638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:03.774826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e1c24f91aa3487ea22ee971a05a2b9f', 'request_id': 'req-6409df90-0299-467d-9f6c-da6c9b8188ab'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:03.786514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e1c24f91aa3487ea22ee971a05a2b9f', 'request_id': 'req-6409df90-0299-467d-9f6c-da6c9b8188ab'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:03.799246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e1c24f91aa3487ea22ee971a05a2b9f', 'request_id': 'req-6409df90-0299-467d-9f6c-da6c9b8188ab'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:03.813473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] The token cache is being invalidate because project 2e1c24f91aa3487ea22ee971a05a2b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:03.813763 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:03.814524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:03.820152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:03.832730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 890/1799] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:03 2022] DELETE /identity/v3/projects/2e1c24f91aa3487ea22ee971a05a2b9f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:03.842580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84ca7e-0bbc-4efb-97c2-5a76e53fc516 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:03.927819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:03.929899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:03.930203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:03.930531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] PATH_INFO: `/v3/users/f1889d5210cb48269bde97cabc472a70` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:03.931795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1889d5210cb48269bde97cabc472a70)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:03.934814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:04.039888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1889d5210cb48269bde97cabc472a70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.063110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:04.066294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1889d5210cb48269bde97cabc472a70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.080646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1889d5210cb48269bde97cabc472a70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.096819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1889d5210cb48269bde97cabc472a70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.097592 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1889d5210cb48269bde97cabc472a70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.106675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 910/1800] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:03 2022] DELETE /identity/v3/users/f1889d5210cb48269bde97cabc472a70 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:04.508382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:04.509931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:04.541332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6409df90-0299-467d-9f6c-da6c9b8188ab admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:04.588764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:04.590381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:04.604447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:04.651670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:04.652891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:04.653275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:04.654008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] PATH_INFO: `/v3/projects/415c3149f1bf48218de18b4d4c13642b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:04.657490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=415c3149f1bf48218de18b4d4c13642b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:04.660869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:04.720242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852ea7-090d-4036-8605-e1306e38d8e5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:04.751629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:04.751629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:04.751629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:04.751629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] PATH_INFO: `/v3/users/414e11ace58d411ca2dfd67a67ca62a7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:04.752080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] RBAC: Authorizing `identity:delete_user(user_id=414e11ace58d411ca2dfd67a67ca62a7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:04.780109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:04.802734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415c3149f1bf48218de18b4d4c13642b', 'request_id': 'req-e74adf4d-5c95-483b-8e79-95ecaa5b2372'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.816941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415c3149f1bf48218de18b4d4c13642b', 'request_id': 'req-e74adf4d-5c95-483b-8e79-95ecaa5b2372'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.827757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415c3149f1bf48218de18b4d4c13642b', 'request_id': 'req-e74adf4d-5c95-483b-8e79-95ecaa5b2372'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.858451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] The token cache is being invalidate because project 415c3149f1bf48218de18b4d4c13642b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:04.858970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.861122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e74adf4d-5c95-483b-8e79-95ecaa5b2372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:04.870832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 891/1801] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:04 2022] DELETE /identity/v3/projects/415c3149f1bf48218de18b4d4c13642b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:04.877070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71d74-a2be-4711-a1e2-e94865ae7dc0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:04.877357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71d74-a2be-4711-a1e2-e94865ae7dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:04.877636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca71d74-a2be-4711-a1e2-e94865ae7dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:04.925707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4ca71d74-a2be-4711-a1e2-e94865ae7dc0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:04.927170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4ca71d74-a2be-4711-a1e2-e94865ae7dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:04.992434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '414e11ace58d411ca2dfd67a67ca62a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:05.033119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '414e11ace58d411ca2dfd67a67ca62a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:05.045092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '414e11ace58d411ca2dfd67a67ca62a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:05.068874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '414e11ace58d411ca2dfd67a67ca62a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:05.071131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-be7aeb15-f3d8-4b85-8e60-2ce080fe443e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '414e11ace58d411ca2dfd67a67ca62a7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:05.084646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 911/1802] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:04 2022] DELETE /identity/v3/users/414e11ace58d411ca2dfd67a67ca62a7 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:05.091754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.092054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.092143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.104223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 892/1803] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:05.112139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.112504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.112704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.138616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:05.139792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:05.152124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:05.156818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:05.247038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:05.257416 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 893/1804] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:05.258454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.279871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93dad-85b7-4309-8384-2b5c84f53cf7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.286628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.286628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.286947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.287037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.287825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:05.288137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.289914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.292876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:05.297133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 912/1805] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:05.303988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.306039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:05.317625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 894/1806] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:58:05.319151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.331279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff429e9-e319-4c9e-ad22-b3e63012338e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.337197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.338369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.338889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.339350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.340233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.342357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.395022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 895/1807] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:05 2022] POST /identity/v3/projects => generated 363 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:05.397793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3bbca-b87b-4d6c-9b49-de332be6354f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.398270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.474845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.475565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.475849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.476123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.494811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda02eb1-4627-413e-a0e6-1202a88941af admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.501657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.502619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.503195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.503735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.505310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.532888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.565791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.573880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.598386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 896/1808] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:05 2022] POST /identity/v3/users => generated 282 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:05.601502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.602507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 913/1809] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:05.628641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625ec90-7144-4c73-b95b-c42f200d6484 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.637220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.638961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.639246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.639567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.641525 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.643425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.662465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 897/1810] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:05.664958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.680377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d70b4-03eb-4fb9-b23a-8e449bce79c9 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.693578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b6a5d-22e6-487f-8d4b-ecceefc15c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.697012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6a5d-22e6-487f-8d4b-ecceefc15c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.697568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6a5d-22e6-487f-8d4b-ecceefc15c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.697568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b6a5d-22e6-487f-8d4b-ecceefc15c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.698297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6a5d-22e6-487f-8d4b-ecceefc15c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.700056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b6a5d-22e6-487f-8d4b-ecceefc15c97 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.717884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 914/1811] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:05.721997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:05.733595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbb7bd-3941-4481-8d33-634f7f225bcc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:05.739681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:05.740930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.741376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.741753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] PATH_INFO: `/v3/projects/0095bcec8194477ebff975b796909242/users/d0a10e71785941458ae826ee06fd9496/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.779041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0095bcec8194477ebff975b796909242, user_id=d0a10e71785941458ae826ee06fd9496, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:05.781801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:05.808159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 898/1812] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:05 2022] PUT /identity/v3/projects/0095bcec8194477ebff975b796909242/users/d0a10e71785941458ae826ee06fd9496/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:05.820792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:05.821085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:05.821367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:05.860155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] MFA Rules not processed for user `d0a10e71785941458ae826ee06fd9496`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:05.861367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:05.913863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:05.950458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 915/1813] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:05.953599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.042806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23aa9fd-55a7-4fb5-8a62-741f175e0f4a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.048272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.049528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.051277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.051573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.052277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.070156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.104448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.106056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.123241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 899/1814] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:05 2022] POST /identity/v3/projects => generated 363 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:06.133333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cb52d-978b-439f-9d67-5a8a40fbaf54 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.136861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.164678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:06.205247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.206210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.206586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.206928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] PATH_INFO: `/v3/projects/ce069086fb004f4595ec2fe264ac4d1e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.208191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce069086fb004f4595ec2fe264ac4d1e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.210309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.216847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bde54e1-9302-4c63-9596-aec091e8c6f7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.221486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.222154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.222585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.222747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.223431 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.226010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.249130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 900/1815] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:06 2022] POST /identity/v3/users => generated 288 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:06.250228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.260427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce069086fb004f4595ec2fe264ac4d1e', 'request_id': 'req-9981e056-c70f-45ea-bd33-4f4a64e24821'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.260670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548536f-b155-45de-9db5-072fc3aa70a0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.267302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce069086fb004f4595ec2fe264ac4d1e', 'request_id': 'req-9981e056-c70f-45ea-bd33-4f4a64e24821'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.276203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce069086fb004f4595ec2fe264ac4d1e', 'request_id': 'req-9981e056-c70f-45ea-bd33-4f4a64e24821'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.287245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] The token cache is being invalidate because project ce069086fb004f4595ec2fe264ac4d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:06.287600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.288249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.289835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 916/1816] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:06 2022] DELETE /identity/v3/projects/ce069086fb004f4595ec2fe264ac4d1e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:06.293845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.295707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.323553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.324224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.324508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.324787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.325503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.327145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.340424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 901/1817] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:06.341493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.343115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.355671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336b6a1-9a8d-4f5a-b60c-6a9d2014a0fc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.360545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.361334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981e056-c70f-45ea-bd33-4f4a64e24821 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.361519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.361852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.362131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] PATH_INFO: `/v3/projects/dd13c918656d4e6e879c826d92df20a8/users/483c97467fcc4f6ca414ae33aec89e21/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.366435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.367340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.367625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.367990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] PATH_INFO: `/v3/users/e752954e6ec04090bf81849c84925259` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.369241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e752954e6ec04090bf81849c84925259)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.371208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.379402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd13c918656d4e6e879c826d92df20a8, user_id=483c97467fcc4f6ca414ae33aec89e21, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.382368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.385698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:06.399383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 902/1818] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:06 2022] PUT /identity/v3/projects/dd13c918656d4e6e879c826d92df20a8/users/483c97467fcc4f6ca414ae33aec89e21/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:06.403539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.423671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e752954e6ec04090bf81849c84925259'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.435709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e752954e6ec04090bf81849c84925259'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.444381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e752954e6ec04090bf81849c84925259'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.452170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e752954e6ec04090bf81849c84925259'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.452844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e752954e6ec04090bf81849c84925259'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.458972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 917/1819] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:06 2022] DELETE /identity/v3/users/e752954e6ec04090bf81849c84925259 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:06.466491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f68c8-693b-4fbc-83f5-d9ac34a81d6b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.485553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:06.528441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd66dfb-4f88-4ad2-a636-4eaefbf6ccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.529032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd66dfb-4f88-4ad2-a636-4eaefbf6ccea admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.529310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd66dfb-4f88-4ad2-a636-4eaefbf6ccea admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.529583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd66dfb-4f88-4ad2-a636-4eaefbf6ccea admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.530308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd66dfb-4f88-4ad2-a636-4eaefbf6ccea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.531930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd66dfb-4f88-4ad2-a636-4eaefbf6ccea admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.542011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 903/1820] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:06.546306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.547964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.562541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccfd01-4af7-4fe0-a724-29876f992925 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.568060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.569007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.569481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.569765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] PATH_INFO: `/v3/projects/dd13c918656d4e6e879c826d92df20a8/users/483c97467fcc4f6ca414ae33aec89e21/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.572061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd13c918656d4e6e879c826d92df20a8, user_id=483c97467fcc4f6ca414ae33aec89e21, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.575009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.586122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 918/1821] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:06 2022] PUT /identity/v3/projects/dd13c918656d4e6e879c826d92df20a8/users/483c97467fcc4f6ca414ae33aec89e21/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:06.596609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.596902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.597181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.626955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] MFA Rules not processed for user `483c97467fcc4f6ca414ae33aec89e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:06.628152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.700934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 904/1822] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:06.712795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.714535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.745662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.747663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.778114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60bf43-5320-4ea1-ab95-bce149871383 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.782026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.782743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.783030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.783308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.794088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.795563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.807669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 919/1823] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:06.829156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb3057-d8f9-4939-8152-4f0a76fd08e8 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.838075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.839058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.839337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.839679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] PATH_INFO: `/v3/projects/d3acef0c7a9544189368b7f8ac56bb28` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.840901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3acef0c7a9544189368b7f8ac56bb28)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:06.842900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:06.897678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:06.900540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3acef0c7a9544189368b7f8ac56bb28', 'request_id': 'req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.904218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:06.905957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.907713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3acef0c7a9544189368b7f8ac56bb28', 'request_id': 'req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.915801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3acef0c7a9544189368b7f8ac56bb28', 'request_id': 'req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.917709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a70eb87-4e28-4f6e-b698-a5e5ba5667c0 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:06.926704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] The token cache is being invalidate because project d3acef0c7a9544189368b7f8ac56bb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:06.926993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.927630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e94e354-1e37-4278-8fc1-0a9f7d37b55f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:06.929259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 905/1824] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:06 2022] DELETE /identity/v3/projects/d3acef0c7a9544189368b7f8ac56bb28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:06.933978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b118d-f529-47c9-8604-9ff28b0b4b00 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.934349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b118d-f529-47c9-8604-9ff28b0b4b00 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.934814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b118d-f529-47c9-8604-9ff28b0b4b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.953345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-832b118d-f529-47c9-8604-9ff28b0b4b00 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:06.954665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-832b118d-f529-47c9-8604-9ff28b0b4b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:06.968801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:06.969453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:06.969750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:06.970010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:06.971789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:07.012498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:07.014683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 906/1825] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:07.024255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.024532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.024827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.043550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:07.044697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:07.046728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.048239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.052677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 907/1826] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:07.057175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.058864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 920/1827] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:07.069884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709e6af-0ca9-4eaf-9904-8dcafaef2da1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.075122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.075788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.076065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.076334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.077052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:07.077353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.079028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.102839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 908/1828] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:07.104270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.118095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59acda-8c0c-439e-abe9-a61a68acefce service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.122841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.123646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.123932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.124206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.124898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.126819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.158460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 921/1829] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:07 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:07.163352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.181741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae62895-9249-4f96-b204-421d4b236573 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.283530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.284325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.284671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.284958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.285784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.287902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.309216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 909/1830] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:07 2022] POST /identity/v3/users => generated 290 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:07.313389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.323848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea733c-b458-4040-ac8f-b42e88d4220f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.328320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.328983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.329262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.329534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.330256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.331868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.342292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 922/1831] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:07.346367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.356331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753cac8-2cd2-4771-a5eb-bf871ff0d962 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.360945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa6c5f-487c-45ec-87d4-b78c1ff459bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.361598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa6c5f-487c-45ec-87d4-b78c1ff459bf admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.361877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa6c5f-487c-45ec-87d4-b78c1ff459bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.362149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa6c5f-487c-45ec-87d4-b78c1ff459bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.362977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa6c5f-487c-45ec-87d4-b78c1ff459bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.364564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa6c5f-487c-45ec-87d4-b78c1ff459bf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.374838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 910/1832] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:07.379308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.389274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61513347-d635-42ef-b99c-f63214613902 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.394278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.395189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.395467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.395734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] PATH_INFO: `/v3/projects/610fe4ef2b5743aaae00a10af14c34bf/users/02909267278c4f1eada6e71dd6ab46ca/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.411707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=610fe4ef2b5743aaae00a10af14c34bf, user_id=02909267278c4f1eada6e71dd6ab46ca, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.414739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.430355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 923/1833] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:07 2022] PUT /identity/v3/projects/610fe4ef2b5743aaae00a10af14c34bf/users/02909267278c4f1eada6e71dd6ab46ca/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:07.441044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.441337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.441622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.470616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] MFA Rules not processed for user `02909267278c4f1eada6e71dd6ab46ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:07.471857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:07.493466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:07.542689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 911/1834] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:07.547357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.615157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4fd918-33c4-4c57-aa46-93fc36c4f7aa admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.620338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.621054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.621370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.621643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.622365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.624374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.654129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 924/1835] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:07 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:07.658376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.670412 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906ffc2-9a7d-40c4-99e0-9d8d6ff65f20 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.734805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.735494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.735807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.736122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.736832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.738860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.759650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 912/1836] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:07 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:07.763724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.778808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d4703-f8b2-44ca-a92a-e7d12d00d059 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.785604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.786313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.786678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.786957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.787810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.789525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.813625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 925/1837] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:07.818136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.842302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a956a-218a-49a6-8896-3b435e434831 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:07.849451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:07.851003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:07.851452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:07.851890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] PATH_INFO: `/v3/projects/a9ac4e71278b464dbc71bf7e03cf3ddd/users/dea728c726e94e76a934022c9f97bc2c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:07.879480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ac4e71278b464dbc71bf7e03cf3ddd, user_id=dea728c726e94e76a934022c9f97bc2c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:07.883033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:07.913637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 913/1838] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:07 2022] PUT /identity/v3/projects/a9ac4e71278b464dbc71bf7e03cf3ddd/users/dea728c726e94e76a934022c9f97bc2c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:07.918884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:07.941805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4cfc89-44ea-4e33-84a8-c95a0a0b56cc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:08.025289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:08.041527 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b43f58-8109-4c63-bca3-64dc412135cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:08.042210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b43f58-8109-4c63-bca3-64dc412135cc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:08.042546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b43f58-8109-4c63-bca3-64dc412135cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:08.042844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b43f58-8109-4c63-bca3-64dc412135cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:08.043626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b43f58-8109-4c63-bca3-64dc412135cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:08.045310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b43f58-8109-4c63-bca3-64dc412135cc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:08.055967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 926/1839] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:08.061003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:08.077908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8eeae-11d2-48ba-abc6-cdd9e4c69b02 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:08.083510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:08.084961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:08.085337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:08.085712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] PATH_INFO: `/v3/projects/a9ac4e71278b464dbc71bf7e03cf3ddd/users/dea728c726e94e76a934022c9f97bc2c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:08.088743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ac4e71278b464dbc71bf7e03cf3ddd, user_id=dea728c726e94e76a934022c9f97bc2c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:08.091890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:08.108658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 914/1840] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:08 2022] PUT /identity/v3/projects/a9ac4e71278b464dbc71bf7e03cf3ddd/users/dea728c726e94e76a934022c9f97bc2c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:08.120076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:08.120716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:08.120716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:08.166824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] MFA Rules not processed for user `dea728c726e94e76a934022c9f97bc2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:08.168806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:08.280386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 927/1841] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:08.291125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:08.293111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:08.398759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8da5bd-8b5a-440b-a9b5-6d3024977118 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:08.409851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8107c8e6-d5e4-4a56-89ab-edaf3958f901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:08.410718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c8e6-d5e4-4a56-89ab-edaf3958f901 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:08.411116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c8e6-d5e4-4a56-89ab-edaf3958f901 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:08.411469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8107c8e6-d5e4-4a56-89ab-edaf3958f901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:08.423002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c8e6-d5e4-4a56-89ab-edaf3958f901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:08.424916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8107c8e6-d5e4-4a56-89ab-edaf3958f901 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:08.449521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 915/1842] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:09.041522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:09.129158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9908-49dd-48e6-bb7e-9976d0a6a4c3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:09.134228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:09.135314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:09.135597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:09.135875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] PATH_INFO: `/v3/users/02909267278c4f1eada6e71dd6ab46ca` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:09.137051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=02909267278c4f1eada6e71dd6ab46ca)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:09.139025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:09.196112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02909267278c4f1eada6e71dd6ab46ca'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.207934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02909267278c4f1eada6e71dd6ab46ca'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.215813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02909267278c4f1eada6e71dd6ab46ca'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.220414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:09.223913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02909267278c4f1eada6e71dd6ab46ca'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.224644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02909267278c4f1eada6e71dd6ab46ca'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.232621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 928/1843] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:09 2022] DELETE /identity/v3/users/02909267278c4f1eada6e71dd6ab46ca => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:09.237461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:09.237985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:09.238074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:09.262321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:09.263571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:09.279289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:09.338114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 916/1844] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:09.348985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:09.350610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:09.409489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce6092-393e-43f2-a8ce-1ae7b60fd7da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:09.413110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:09.413762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:09.414046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:09.414326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:09.423562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:09.424990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:09.434872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 929/1845] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:09.708253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:09.710140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:09.727021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3414d956-aa36-49aa-ad1d-05523a6ed515 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:09.731837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:09.732875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:09.733221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:09.733560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] PATH_INFO: `/v3/projects/610fe4ef2b5743aaae00a10af14c34bf` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:09.735810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610fe4ef2b5743aaae00a10af14c34bf)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:09.738529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:09.790573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610fe4ef2b5743aaae00a10af14c34bf', 'request_id': 'req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.798406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610fe4ef2b5743aaae00a10af14c34bf', 'request_id': 'req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.806863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610fe4ef2b5743aaae00a10af14c34bf', 'request_id': 'req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.818142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] The token cache is being invalidate because project 610fe4ef2b5743aaae00a10af14c34bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:09.818457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.819391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.821055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 917/1846] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:09 2022] DELETE /identity/v3/projects/610fe4ef2b5743aaae00a10af14c34bf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:09.826273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:09.836516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2873e8-7dfe-45ef-9ee9-7a46604470e1 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:09.894544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:09.895457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:09.895772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:09.896048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] PATH_INFO: `/v3/users/dea728c726e94e76a934022c9f97bc2c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:09.897362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dea728c726e94e76a934022c9f97bc2c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:09.899308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:09.954263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dea728c726e94e76a934022c9f97bc2c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.967854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dea728c726e94e76a934022c9f97bc2c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.976954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dea728c726e94e76a934022c9f97bc2c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.983992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dea728c726e94e76a934022c9f97bc2c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.984681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cca77cde-032b-4719-a124-6b9891314820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dea728c726e94e76a934022c9f97bc2c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:09.991038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 930/1847] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:09 2022] DELETE /identity/v3/users/dea728c726e94e76a934022c9f97bc2c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:10.297742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.299160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:10.312553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a2b5a8-e888-4c5f-8773-d87c23caeed7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.387071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.387988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.388227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.388501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] PATH_INFO: `/v3/projects/a9ac4e71278b464dbc71bf7e03cf3ddd` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.389711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ac4e71278b464dbc71bf7e03cf3ddd)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.392036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.440229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:10.445190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ac4e71278b464dbc71bf7e03cf3ddd', 'request_id': 'req-4890595e-8d55-4688-9971-bbc7c8c678fa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:10.453117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ac4e71278b464dbc71bf7e03cf3ddd', 'request_id': 'req-4890595e-8d55-4688-9971-bbc7c8c678fa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:10.462673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ac4e71278b464dbc71bf7e03cf3ddd', 'request_id': 'req-4890595e-8d55-4688-9971-bbc7c8c678fa'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:10.473727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] The token cache is being invalidate because project a9ac4e71278b464dbc71bf7e03cf3ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:10.474017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:10.474674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4890595e-8d55-4688-9971-bbc7c8c678fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:10.476266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 918/1848] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:10 2022] DELETE /identity/v3/projects/a9ac4e71278b464dbc71bf7e03cf3ddd => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:10.482120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.482656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.482753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.501349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:10.502550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:10.513384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:10.604731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 931/1849] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:10.612947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.613270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.613553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.632542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:10.633749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:10.643398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 919/1850] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:10.647949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.657668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96421584-46fa-42b4-a218-eb90bcec49ad None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.662693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.663371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.663650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.663926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.664653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:10.664957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.666570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.679568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 932/1851] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:10.683904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.693742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef40d1-a253-48ae-bfa9-90208a74618c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.698938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.699588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.699870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.700168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.700853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.702821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.730768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 920/1852] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:10 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:10.735082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.745679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83f8269-e9bf-41d5-bb18-2ee86566b6a5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.814879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.815770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.816689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.816969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.817836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.820612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.846614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 933/1853] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:10 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:10.847803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.858578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3e33b-975b-4f07-a1f8-a440fa16b311 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.870097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.870818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.871093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.871345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.872159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.873683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.885147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 921/1854] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:10.890998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.901672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd89893c-01d1-4d2f-b01c-35486d1bf45e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.907622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6e9a4-97e7-4ce0-b07a-5df38f51b757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.908478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e9a4-97e7-4ce0-b07a-5df38f51b757 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.908763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e9a4-97e7-4ce0-b07a-5df38f51b757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.909035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6e9a4-97e7-4ce0-b07a-5df38f51b757 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.909761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e9a4-97e7-4ce0-b07a-5df38f51b757 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.911466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd6e9a4-97e7-4ce0-b07a-5df38f51b757 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.922818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 934/1855] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:10.927177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:10.939472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e59011-37a4-4b20-896d-99af3998257a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:10.945488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:10.946387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:10.946702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:10.946991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] PATH_INFO: `/v3/projects/d154961a03d14159bd902931abfec0af/users/66b25071ad6a4a1b8256ac1b40955fd6/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:10.964108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154961a03d14159bd902931abfec0af, user_id=66b25071ad6a4a1b8256ac1b40955fd6, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:10.966839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:10.982696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 922/1856] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:10 2022] PUT /identity/v3/projects/d154961a03d14159bd902931abfec0af/users/66b25071ad6a4a1b8256ac1b40955fd6/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:11.007627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:11.007976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:11.008252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:11.059430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] MFA Rules not processed for user `66b25071ad6a4a1b8256ac1b40955fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:11.061300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:11.225001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 935/1857] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:11.246827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:11.249212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:11.429622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f981c-ef69-4c6f-8d13-f01e642f8c65 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:11.442691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf190c-b365-4c5e-8177-096de49b405d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:11.443747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf190c-b365-4c5e-8177-096de49b405d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:11.444448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf190c-b365-4c5e-8177-096de49b405d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:11.444674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf190c-b365-4c5e-8177-096de49b405d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:11.468292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf190c-b365-4c5e-8177-096de49b405d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:11.473281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf190c-b365-4c5e-8177-096de49b405d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:11.498292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 923/1858] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:12.496713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:12.498328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:12.517531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:12.583414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1fe445-ab3b-42c6-87e3-1dab4fa2df43 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:12.589049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:12.590168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:12.590566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:12.590913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] PATH_INFO: `/v3/users/48f8547f34bf412b97e329eb45ee7b3d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:12.592943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f8547f34bf412b97e329eb45ee7b3d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:12.594835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:12.673144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f8547f34bf412b97e329eb45ee7b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:12.696727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f8547f34bf412b97e329eb45ee7b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:12.709205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f8547f34bf412b97e329eb45ee7b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:12.722922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f8547f34bf412b97e329eb45ee7b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:12.726808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f8547f34bf412b97e329eb45ee7b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:12.737296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 936/1859] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:12 2022] DELETE /identity/v3/users/48f8547f34bf412b97e329eb45ee7b3d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:12.742194 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:12.742742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:12.743037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:12.768730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:12.770168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:12.853173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 924/1860] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:12.865760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:12.871462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:12.961035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76deb6-2282-4737-9da1-34f17cd257e1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:12.965060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:12.966313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:12.966662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:12.966911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:12.978007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:12.979511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:12.994600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 937/1861] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:13.306803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:13.308746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:13.335327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e757710-aec2-4c0a-b282-e8faa55c182c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:13.341036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:13.341947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:13.342369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:13.342685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] PATH_INFO: `/v3/projects/023683ceccc44b7b9fabf4e5e14ab3a1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:13.343917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=023683ceccc44b7b9fabf4e5e14ab3a1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:13.345837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:13.354641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:13.411640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023683ceccc44b7b9fabf4e5e14ab3a1', 'request_id': 'req-207c10ae-7b63-43d6-b582-940a8b8a4f7f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.420640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023683ceccc44b7b9fabf4e5e14ab3a1', 'request_id': 'req-207c10ae-7b63-43d6-b582-940a8b8a4f7f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.429078 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023683ceccc44b7b9fabf4e5e14ab3a1', 'request_id': 'req-207c10ae-7b63-43d6-b582-940a8b8a4f7f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.440888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] The token cache is being invalidate because project 023683ceccc44b7b9fabf4e5e14ab3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:13.441271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.441979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.443815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 925/1862] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:13 2022] DELETE /identity/v3/projects/023683ceccc44b7b9fabf4e5e14ab3a1 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:13.448503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:13.458460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f129a7-8b2e-4ebc-8ef3-5e2d2e865a6b service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:13.491658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:13.522486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:13.523379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:13.523814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:13.524226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] PATH_INFO: `/v3/users/9fcd4e1340f044ab8ad455274233be70` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:13.525571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fcd4e1340f044ab8ad455274233be70)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:13.527669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:13.594022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fcd4e1340f044ab8ad455274233be70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.624495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fcd4e1340f044ab8ad455274233be70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.634496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fcd4e1340f044ab8ad455274233be70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.642979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fcd4e1340f044ab8ad455274233be70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.643623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-f68e6148-0e00-4c7b-83e8-e81d4101fa1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fcd4e1340f044ab8ad455274233be70'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:13.650267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 938/1863] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:13 2022] DELETE /identity/v3/users/9fcd4e1340f044ab8ad455274233be70 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:13.973115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:13.974730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:14.007025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c10ae-7b63-43d6-b582-940a8b8a4f7f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.080059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.080930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.081212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.081487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] PATH_INFO: `/v3/projects/550aa9fa880544a5be8ce242f407c03d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.082744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=550aa9fa880544a5be8ce242f407c03d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.084844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.143017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550aa9fa880544a5be8ce242f407c03d', 'request_id': 'req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:14.150149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550aa9fa880544a5be8ce242f407c03d', 'request_id': 'req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:14.158593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550aa9fa880544a5be8ce242f407c03d', 'request_id': 'req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:14.172460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] The token cache is being invalidate because project 550aa9fa880544a5be8ce242f407c03d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:14.172805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:14.173719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1d02ccec-bdbf-44ce-a2ff-b2b8bc35b7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:14.176018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 926/1864] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:13 2022] DELETE /identity/v3/projects/550aa9fa880544a5be8ce242f407c03d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:14.181659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.182023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.182309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.202281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:14.203562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:14.274685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 939/1865] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:14.288026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9da8-e663-4953-835e-419bf1baddac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.288315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9da8-e663-4953-835e-419bf1baddac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.288592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f9da8-e663-4953-835e-419bf1baddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.307485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-095f9da8-e663-4953-835e-419bf1baddac None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:14.308731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-095f9da8-e663-4953-835e-419bf1baddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:14.316944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 927/1866] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:14.321594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.331651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6518f18b-4fb4-46be-9a39-c00363e57785 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.336832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.337525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.337809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.338078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.338845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:14.339152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.340763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.353971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 940/1867] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:14.359900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f9da8-e663-4953-835e-419bf1baddac None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.370197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f9da8-e663-4953-835e-419bf1baddac None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.377349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.377937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.378248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.378519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.379245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.381293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.396203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:14.414457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 928/1868] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:14 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:14.418337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.429878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9289896-4666-4a85-baaf-eede0fbe76d2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.488681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:14.521345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.522309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.522711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.523268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.523785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.526842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.551080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 941/1869] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:14 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:14.556211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.566988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95479fa0-ffdb-4977-86ff-eb1417af58d2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.573407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.574071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.574379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.574678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.575505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.577154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.588781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 929/1870] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:14.593047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.603874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f19adb-b9d3-4fa4-8dc5-a84209a99c1a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.609381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22131acc-4b4c-47ae-8693-43a1b5404dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.610058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22131acc-4b4c-47ae-8693-43a1b5404dde admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.610344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22131acc-4b4c-47ae-8693-43a1b5404dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.610655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22131acc-4b4c-47ae-8693-43a1b5404dde admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.611391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22131acc-4b4c-47ae-8693-43a1b5404dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.612997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22131acc-4b4c-47ae-8693-43a1b5404dde admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.623607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 942/1871] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:14.629244 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.640385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd760b66-577b-45b8-b36c-3f9f43542a64 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.645140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.646055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.646332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.646779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] PATH_INFO: `/v3/projects/d3cca5ff78ef46ebb422a667a15ee79d/users/96ee15bbf28f4b24b7a04203e05434c6/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.662724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3cca5ff78ef46ebb422a667a15ee79d, user_id=96ee15bbf28f4b24b7a04203e05434c6, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.665357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.681133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 930/1872] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:14 2022] PUT /identity/v3/projects/d3cca5ff78ef46ebb422a667a15ee79d/users/96ee15bbf28f4b24b7a04203e05434c6/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:14.691250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.691536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.691813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.720826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] MFA Rules not processed for user `96ee15bbf28f4b24b7a04203e05434c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:14.722263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:14.797629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 943/1873] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:14.811534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:14.817506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:14.889046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5165dd9-55ee-47b8-a9cb-e07a7cde2ccd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:14.896362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38fb90-3258-4834-bde9-2cd376efb837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:14.897135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38fb90-3258-4834-bde9-2cd376efb837 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:14.897459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38fb90-3258-4834-bde9-2cd376efb837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:14.897740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38fb90-3258-4834-bde9-2cd376efb837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:14.912061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38fb90-3258-4834-bde9-2cd376efb837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:14.913725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38fb90-3258-4834-bde9-2cd376efb837 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:14.925698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 931/1874] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:17.099416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:17.101187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:17.269825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd8794-8f23-4c8a-afe0-2e26b0be18fa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:17.302240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:17.303279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:17.303564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:17.303838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] PATH_INFO: `/v3/users/66b25071ad6a4a1b8256ac1b40955fd6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:17.307205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b25071ad6a4a1b8256ac1b40955fd6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:17.309179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:17.406605 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b25071ad6a4a1b8256ac1b40955fd6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:17.409661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:17.433746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b25071ad6a4a1b8256ac1b40955fd6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:17.449340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b25071ad6a4a1b8256ac1b40955fd6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:17.460203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b25071ad6a4a1b8256ac1b40955fd6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:17.461295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b25071ad6a4a1b8256ac1b40955fd6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:17.470734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 944/1875] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:17 2022] DELETE /identity/v3/users/66b25071ad6a4a1b8256ac1b40955fd6 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:17.475825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5734-6a86-4c3d-8f11-a985b1768424 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:17.475825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5734-6a86-4c3d-8f11-a985b1768424 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:17.476408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58de5734-6a86-4c3d-8f11-a985b1768424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:17.498543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-58de5734-6a86-4c3d-8f11-a985b1768424 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:17.499913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-58de5734-6a86-4c3d-8f11-a985b1768424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:17.581183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 932/1876] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:17.593750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:17.596212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:17.672837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e6eea-6c19-491d-a4c3-48f9aca9ac09 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:17.678710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bfdcc1-e669-4168-a825-b24249902c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:17.679551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdcc1-e669-4168-a825-b24249902c90 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:17.679905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdcc1-e669-4168-a825-b24249902c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:17.680253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bfdcc1-e669-4168-a825-b24249902c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:17.697331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfdcc1-e669-4168-a825-b24249902c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:17.699427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bfdcc1-e669-4168-a825-b24249902c90 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:17.715166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 945/1877] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:17.808668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad1e71-70dd-4741-bf43-878a3c592cd9 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:17.808961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad1e71-70dd-4741-bf43-878a3c592cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:17.809248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad1e71-70dd-4741-bf43-878a3c592cd9 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:17.810695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 933/1878] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:58:17.817448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:17.817742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:17.818095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:17.864044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:17.865411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:17.964954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 946/1879] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:17.979275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad1e71-70dd-4741-bf43-878a3c592cd9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:17.981115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0dad1e71-70dd-4741-bf43-878a3c592cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:18.006371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad1e71-70dd-4741-bf43-878a3c592cd9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.013131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a5dc7-76fd-48b6-92e8-1d6837942a70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.013836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a5dc7-76fd-48b6-92e8-1d6837942a70 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.014154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a5dc7-76fd-48b6-92e8-1d6837942a70 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.014453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a5dc7-76fd-48b6-92e8-1d6837942a70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.030327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a5dc7-76fd-48b6-92e8-1d6837942a70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.032127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a5dc7-76fd-48b6-92e8-1d6837942a70 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.056634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 934/1880] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:18.178958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.180483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:18.200403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb909d-bfcf-4c57-b8b7-04cb676e718e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.219856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.220762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.221046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.221320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] PATH_INFO: `/v3/projects/d154961a03d14159bd902931abfec0af` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.222630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d154961a03d14159bd902931abfec0af)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.224685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.283524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd154961a03d14159bd902931abfec0af', 'request_id': 'req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:18.292774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd154961a03d14159bd902931abfec0af', 'request_id': 'req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:18.296726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:18.303155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd154961a03d14159bd902931abfec0af', 'request_id': 'req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:18.318337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] The token cache is being invalidate because project d154961a03d14159bd902931abfec0af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:18.318688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:18.319951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a9cdd2d5-33a3-4ca0-b550-be6ae3800836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:18.321867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 947/1881] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:18 2022] DELETE /identity/v3/projects/d154961a03d14159bd902931abfec0af => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:18.327278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.327574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.327878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.350842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:18.352147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:18.403006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:18.418616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 935/1882] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:18.428065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.428876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.429389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.451572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:18.452925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:18.463851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 948/1883] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:18.468536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.479350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41e006-2a2a-4f93-babe-0118fa078671 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.484289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.485047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.485379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.485695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.486405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:18.486741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.488595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.505247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 936/1884] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:58:18.506541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.516485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269ea06-0b26-4b7e-8692-694d35a81c65 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.522643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.523400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.523744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.524189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.524951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.527448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.602817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 949/1885] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:18 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:18.606730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.622812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6daa70-bad6-4032-82b1-d4ecff9db23f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.730616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.731782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.732283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.732698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.733626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.735897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.774481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 937/1886] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:18 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:18.778544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.792069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b1f98-7067-45ae-8a54-4193c79e3985 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.796679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.797352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.797620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.797898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.798686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.800306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.812307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 950/1887] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:18.816384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.827875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013c2e87-4bfd-4643-986b-c19b9adf0cff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.833536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59686e80-ddcc-4449-a03d-7903bc2a0d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.834921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e80-ddcc-4449-a03d-7903bc2a0d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.835383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e80-ddcc-4449-a03d-7903bc2a0d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.835864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59686e80-ddcc-4449-a03d-7903bc2a0d72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.837196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59686e80-ddcc-4449-a03d-7903bc2a0d72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.839602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59686e80-ddcc-4449-a03d-7903bc2a0d72 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.854240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 938/1888] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:18.855668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:18.866051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c252c0e5-f50e-4274-8741-738ca81d5200 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:18.870924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:18.871812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.872093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.872367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] PATH_INFO: `/v3/projects/b0ade45ab8a443728300076d811bbbb3/users/99c3124cdd2e4497be78c9c085a43658/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.887096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ade45ab8a443728300076d811bbbb3, user_id=99c3124cdd2e4497be78c9c085a43658, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:18.889737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:18.904508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 951/1889] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:18 2022] PUT /identity/v3/projects/b0ade45ab8a443728300076d811bbbb3/users/99c3124cdd2e4497be78c9c085a43658/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:18.915847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86836b6-d839-4225-948d-b1b448085efc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:18.916163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86836b6-d839-4225-948d-b1b448085efc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:18.916444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86836b6-d839-4225-948d-b1b448085efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:18.945979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e86836b6-d839-4225-948d-b1b448085efc None None] MFA Rules not processed for user `99c3124cdd2e4497be78c9c085a43658`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:18.947149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e86836b6-d839-4225-948d-b1b448085efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:19.019724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 939/1890] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:19.032934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:19.034776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:19.096240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bfbb24-aa33-40d3-984c-061ac0597f5d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:19.100192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033dda2-d776-4e7b-b486-34741d2536ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:19.100847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033dda2-d776-4e7b-b486-34741d2536ac service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:19.101134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033dda2-d776-4e7b-b486-34741d2536ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:19.101432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033dda2-d776-4e7b-b486-34741d2536ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:19.110383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033dda2-d776-4e7b-b486-34741d2536ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:19.111838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a033dda2-d776-4e7b-b486-34741d2536ac service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:19.121876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 952/1891] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:20.163728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d76d4-e56e-459a-9997-a3655b9e2dd0 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:20.164200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d76d4-e56e-459a-9997-a3655b9e2dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:20.164314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750d76d4-e56e-459a-9997-a3655b9e2dd0 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:20.166049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 940/1892] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:58:20.193469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901b20d-c938-484a-956a-9935032ff652 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:20.194217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901b20d-c938-484a-956a-9935032ff652 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:20.195674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901b20d-c938-484a-956a-9935032ff652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:20.246302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5901b20d-c938-484a-956a-9935032ff652 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:20.247571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5901b20d-c938-484a-956a-9935032ff652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:20.391755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 953/1893] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:58:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:20.486957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d76d4-e56e-459a-9997-a3655b9e2dd0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:20.489615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-750d76d4-e56e-459a-9997-a3655b9e2dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:20.532914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750d76d4-e56e-459a-9997-a3655b9e2dd0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:20.539847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:20.541389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:20.542117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:20.542699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:20.554806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:20.556812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:20.582706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 941/1894] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:27.065796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901b20d-c938-484a-956a-9935032ff652 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:27.088825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:27.140357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901b20d-c938-484a-956a-9935032ff652 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:27.147825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:27.148906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:27.149193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:27.149513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] PATH_INFO: `/v3/users/99c3124cdd2e4497be78c9c085a43658` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:27.150774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99c3124cdd2e4497be78c9c085a43658)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:27.152843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:27.168753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:27.170446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:27.185383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6b70e1-18f5-4c4d-aa5d-ac94d472e2fc service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:27.191804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:27.192771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:27.193057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:27.193449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] PATH_INFO: `/v3/users/d0a10e71785941458ae826ee06fd9496` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:27.194755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a10e71785941458ae826ee06fd9496)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:27.196770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:27.210217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99c3124cdd2e4497be78c9c085a43658'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.223341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99c3124cdd2e4497be78c9c085a43658'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.227283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:27.232047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99c3124cdd2e4497be78c9c085a43658'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.240887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99c3124cdd2e4497be78c9c085a43658'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.241545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3de4a784-b81f-406e-85f8-927d07189254 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99c3124cdd2e4497be78c9c085a43658'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.247488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a10e71785941458ae826ee06fd9496'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.248926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 954/1895] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:27 2022] DELETE /identity/v3/users/99c3124cdd2e4497be78c9c085a43658 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:27.253040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:27.253335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:27.253621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:27.260362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a10e71785941458ae826ee06fd9496'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.268767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a10e71785941458ae826ee06fd9496'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.269374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a10e71785941458ae826ee06fd9496'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.272533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:27.273784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:27.283519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2c595a87-6906-46c4-ad9e-41b1baa8bc43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a10e71785941458ae826ee06fd9496'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:27.293575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 942/1896] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:27 2022] DELETE /identity/v3/users/d0a10e71785941458ae826ee06fd9496 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:27.297694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:27.297980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:27.298267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:27.319311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:27.320531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:27.343244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 955/1897] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:27.353761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:27.355361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:27.388284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 943/1898] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:27.398827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:27.400243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:27.405450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:27.424354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbbe8-38bd-47dd-b3f8-27c887027728 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:27.468746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e81a6-1926-4c7a-bba7-63fce81e0751 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:27.473099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:27.474154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:27.474497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:27.475588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:27.482635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:27.483291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:27.483568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:27.483841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:27.486973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:27.488418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:27.499028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:27.500172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 944/1899] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:27.503127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:27.516625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 956/1900] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:28.058676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.060217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:28.084766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a79c-76d0-4edb-8212-3768c0de0d7e service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.091439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.092510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.092801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.093238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] PATH_INFO: `/v3/projects/b0ade45ab8a443728300076d811bbbb3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.095093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ade45ab8a443728300076d811bbbb3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.097038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.145946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.149443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:28.174022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a80f5a-393a-4ad4-bd02-f2b08b113832 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.194882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.196694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.198638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.200916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] PATH_INFO: `/v3/projects/0095bcec8194477ebff975b796909242` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.204632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:28.205322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] RBAC: Authorizing `identity:delete_project(project_id=0095bcec8194477ebff975b796909242)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.207374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ade45ab8a443728300076d811bbbb3', 'request_id': 'req-3d3bd65d-cf39-42a3-989e-8228245461db'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.211055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.215129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ade45ab8a443728300076d811bbbb3', 'request_id': 'req-3d3bd65d-cf39-42a3-989e-8228245461db'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.225941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ade45ab8a443728300076d811bbbb3', 'request_id': 'req-3d3bd65d-cf39-42a3-989e-8228245461db'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.253618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] The token cache is being invalidate because project b0ade45ab8a443728300076d811bbbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:28.253842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.254523 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3d3bd65d-cf39-42a3-989e-8228245461db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.257664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 945/1901] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:28 2022] DELETE /identity/v3/projects/b0ade45ab8a443728300076d811bbbb3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:28.263605 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d8d9-fa6e-47fb-b3ac-149b076b2428 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.264210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d8d9-fa6e-47fb-b3ac-149b076b2428 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.264379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81d8d9-fa6e-47fb-b3ac-149b076b2428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.300110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4c81d8d9-fa6e-47fb-b3ac-149b076b2428 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:28.302237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4c81d8d9-fa6e-47fb-b3ac-149b076b2428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:28.325869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0095bcec8194477ebff975b796909242', 'request_id': 'req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.337864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0095bcec8194477ebff975b796909242', 'request_id': 'req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.355458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0095bcec8194477ebff975b796909242', 'request_id': 'req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.374051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] The token cache is being invalidate because project 0095bcec8194477ebff975b796909242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:28.375720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.376816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.378919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 957/1902] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:28 2022] DELETE /identity/v3/projects/0095bcec8194477ebff975b796909242 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:28.383340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.384460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:28.405494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 946/1903] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:28.414892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.415300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.415664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.434186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:28.435434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:28.443563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 947/1904] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:28.447784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.459787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3adb9cf-d236-4c63-9437-63e367d0cc38 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.466048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.467321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.467762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.469032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.469799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:28.470177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.472166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.480690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba2cc3-c79a-48e9-a0ee-e18f1e7768da admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.485691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 948/1905] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:28.489696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.490102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.490731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.491018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.491295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] PATH_INFO: `/v3/users/483c97467fcc4f6ca414ae33aec89e21` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.492542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] RBAC: Authorizing `identity:delete_user(user_id=483c97467fcc4f6ca414ae33aec89e21)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.494511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.503008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fdb7e-1fda-427e-88f9-4b0504ff41a0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.508847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.509902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.510543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.510770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.511497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.513462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.524146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:28.545366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 949/1906] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:28 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:28.550040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.560788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '483c97467fcc4f6ca414ae33aec89e21'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.574534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '483c97467fcc4f6ca414ae33aec89e21'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.582899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '483c97467fcc4f6ca414ae33aec89e21'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.590376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '483c97467fcc4f6ca414ae33aec89e21'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.591303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '483c97467fcc4f6ca414ae33aec89e21'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:28.598322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 958/1907] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:28 2022] DELETE /identity/v3/users/483c97467fcc4f6ca414ae33aec89e21 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:28.631404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b0c164-e658-470d-b6ed-7103a8f2f453 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.679953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:28.722550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.723315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.723664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.724346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.725114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.727562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.758461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 950/1908] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:28 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:28.762289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.764080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:28.781572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fbe3dd-8f84-4f66-a619-c26b88f6124a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.787295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.788141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.788386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.788670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.790232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.792385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.827511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 959/1909] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:28.835571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.847855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93749f1-67b5-4e93-b36e-43f14e759823 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.853017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d016a15-cc2f-4f14-a85f-c41fd4fc2832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.853733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d016a15-cc2f-4f14-a85f-c41fd4fc2832 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.854018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d016a15-cc2f-4f14-a85f-c41fd4fc2832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.854298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d016a15-cc2f-4f14-a85f-c41fd4fc2832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.855076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d016a15-cc2f-4f14-a85f-c41fd4fc2832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.856757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d016a15-cc2f-4f14-a85f-c41fd4fc2832 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.868635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 951/1910] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:28.872647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:28.885097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29421a-21bb-4523-8083-80a3b918b75b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:28.891370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:28.892284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.892685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.893398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] PATH_INFO: `/v3/projects/5dc5a285ee3648b6801039bfb32fd41e/users/587b25657adf404c83518a81f35f933e/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.909670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc5a285ee3648b6801039bfb32fd41e, user_id=587b25657adf404c83518a81f35f933e, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:28.913191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:28.934457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 960/1911] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:28 2022] PUT /identity/v3/projects/5dc5a285ee3648b6801039bfb32fd41e/users/587b25657adf404c83518a81f35f933e/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:28.947037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:28.947628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:28.948352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:28.979079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] MFA Rules not processed for user `587b25657adf404c83518a81f35f933e`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:28.981169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:29.009731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.028661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:29.064733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 952/1912] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:29.075590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.077470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:29.118830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc45ab-483b-45bb-96ab-8410035f353d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.124135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.126804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.127104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.127532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] PATH_INFO: `/v3/projects/dd13c918656d4e6e879c826d92df20a8` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.128811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd13c918656d4e6e879c826d92df20a8)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.130914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.144031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec6c4e-ebd1-487a-bf7b-f17282e61e3b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.148176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d8187-58dc-40ef-8c76-e3c9bd6cce8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.148854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8187-58dc-40ef-8c76-e3c9bd6cce8b service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.149141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8187-58dc-40ef-8c76-e3c9bd6cce8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.149909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d8187-58dc-40ef-8c76-e3c9bd6cce8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.163232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d8187-58dc-40ef-8c76-e3c9bd6cce8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.165500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d8187-58dc-40ef-8c76-e3c9bd6cce8b service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.179745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 953/1913] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:29.196942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd13c918656d4e6e879c826d92df20a8', 'request_id': 'req-05c031d7-741e-4e64-807a-2039a7ff9e0b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:29.204557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd13c918656d4e6e879c826d92df20a8', 'request_id': 'req-05c031d7-741e-4e64-807a-2039a7ff9e0b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:29.214489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd13c918656d4e6e879c826d92df20a8', 'request_id': 'req-05c031d7-741e-4e64-807a-2039a7ff9e0b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:29.217453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:29.230034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] The token cache is being invalidate because project dd13c918656d4e6e879c826d92df20a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:29.230662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:29.232594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05c031d7-741e-4e64-807a-2039a7ff9e0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:29.243738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 961/1914] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:29 2022] DELETE /identity/v3/projects/dd13c918656d4e6e879c826d92df20a8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:29.248391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.248845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.248976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.269962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:29.271612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:29.329221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:29.351457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 954/1915] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:29.359172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.359550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.359728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.389524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:29.392362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:29.428179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 962/1916] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:29.429457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.441321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132965b-8057-4561-9b93-2b40f1de6290 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.450511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.451772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.452264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.452952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.454404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:29.454926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.457588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.498632 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 955/1917] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:58:29.499753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.517108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215384b-70c1-4472-a0c9-37a1363c2251 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.531102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.532318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.532318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.532588 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.533494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.535518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.573830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 963/1918] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:29 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:29.577075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.589914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8d9f-eb19-404f-8b87-e6655345186c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.683466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.684165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.684445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.684768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.685482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.687556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.716322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 956/1919] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:29 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:29.718146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.731331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420bc66-8a75-46bd-8139-e9a65e2d7b8b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.739097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.740009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.740508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.741042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.742230 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.744567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.784213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 964/1920] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:29.787507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.799888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ba8827-1e44-4dfb-8a3e-0e1107039b59 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.810033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6d2a-d7e3-409c-b1b0-fa75e7ab5685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.811010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6d2a-d7e3-409c-b1b0-fa75e7ab5685 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.811289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6d2a-d7e3-409c-b1b0-fa75e7ab5685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.811675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6d2a-d7e3-409c-b1b0-fa75e7ab5685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.812276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6d2a-d7e3-409c-b1b0-fa75e7ab5685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.813913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6d2a-d7e3-409c-b1b0-fa75e7ab5685 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.843193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:29.843812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 957/1921] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:29.860026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7fa393-8a70-4f25-a30e-84ed4efa59e9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:29.867898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:29.869543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.869853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.870246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] PATH_INFO: `/v3/projects/b4599be79f35472d9a8700168bb4ab9d/users/6b0be96a63b748679a5b7c40e321649f/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.895888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4599be79f35472d9a8700168bb4ab9d, user_id=6b0be96a63b748679a5b7c40e321649f, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:29.899449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:29.913443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 965/1922] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:29 2022] PUT /identity/v3/projects/b4599be79f35472d9a8700168bb4ab9d/users/6b0be96a63b748679a5b7c40e321649f/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:29.925091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:29.925289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:29.925594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:29.957103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] MFA Rules not processed for user `6b0be96a63b748679a5b7c40e321649f`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:29.958100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.051372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.053845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.054515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 958/1923] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:30.056042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.128000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:30.148986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e129b3-13ef-4bd4-ae9c-fe3895091ab3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.151578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f2541-6f35-4322-b7a6-12d2a0b464af None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.153718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.154859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.155117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.155393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] PATH_INFO: `/v3/users/bd32fa9b547c40e7b6f1fc0d03b52c7f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.157495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd32fa9b547c40e7b6f1fc0d03b52c7f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.158984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.166748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.167990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.168647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.168936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.169779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.172252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.205769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 959/1924] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:30 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:30.207074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.223928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd32fa9b547c40e7b6f1fc0d03b52c7f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:30.236835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd32fa9b547c40e7b6f1fc0d03b52c7f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:30.246657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd32fa9b547c40e7b6f1fc0d03b52c7f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:30.254834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd32fa9b547c40e7b6f1fc0d03b52c7f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:30.255816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-758d84cb-21a7-4d1e-b0e1-338ed2252b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd32fa9b547c40e7b6f1fc0d03b52c7f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:30.261775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 966/1925] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:30 2022] DELETE /identity/v3/users/bd32fa9b547c40e7b6f1fc0d03b52c7f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:30.266399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.266813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.267225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.279010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:30.280300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd094fac-2564-4418-8093-0f386ff597ce admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.285658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:30.287852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.340780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.341446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.341725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.341997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.342712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.345438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.359412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 967/1926] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:30.372273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 960/1927] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:30 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:30.374471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.376070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.377079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.378812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.392216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde378b9-a79a-4c41-93f3-bf0452379349 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.398368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.399083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.399368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.399642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.400496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.402130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.413146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 961/1928] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:30.417291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.426782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0def5d-e963-407e-b5ee-37fc484a627c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.431923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.432885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.433143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.433415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] PATH_INFO: `/v3/projects/cda909f991784899b15dcf429a22a84b/users/88a2e506afdf460cbd017016dc025ecd/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.436557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47531baa-e382-4a87-97c7-72b9f6f25c61 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.440910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.441553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.441831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.442098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.448711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda909f991784899b15dcf429a22a84b, user_id=88a2e506afdf460cbd017016dc025ecd, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.451442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.451900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.453339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.463104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 968/1929] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:30.465793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 962/1930] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:30 2022] PUT /identity/v3/projects/cda909f991784899b15dcf429a22a84b/users/88a2e506afdf460cbd017016dc025ecd/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:30.469769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.480249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdec86-3d41-498f-8063-1a8d1ccfa271 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.544026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862d51a0-6969-41cc-9376-50b0f526a0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.544857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d51a0-6969-41cc-9376-50b0f526a0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.545327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d51a0-6969-41cc-9376-50b0f526a0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.545620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862d51a0-6969-41cc-9376-50b0f526a0a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.546434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d51a0-6969-41cc-9376-50b0f526a0a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.548778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862d51a0-6969-41cc-9376-50b0f526a0a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.564387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.565224 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 969/1931] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:30.575202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c2608-09d5-47c9-95dd-560dfc7302ad admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.580199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.581363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.581487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.581825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] PATH_INFO: `/v3/projects/cda909f991784899b15dcf429a22a84b/users/88a2e506afdf460cbd017016dc025ecd/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.584027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cda909f991784899b15dcf429a22a84b, user_id=88a2e506afdf460cbd017016dc025ecd, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.587058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.603727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 963/1932] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:30 2022] PUT /identity/v3/projects/cda909f991784899b15dcf429a22a84b/users/88a2e506afdf460cbd017016dc025ecd/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:30.613924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.614213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.614514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.641345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] MFA Rules not processed for user `88a2e506afdf460cbd017016dc025ecd`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:30.642572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.710998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:30.759302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 970/1933] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:30.772084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.774038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:30.798133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:30.845646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7071cee-edd7-475b-8a36-411178038903 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:30.850208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:30.850977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:30.851258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:30.851776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:30.861756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:30.863230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:30.877309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 964/1934] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:30.916238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:30.919121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.012992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e2d5bf-be40-42fd-9cc2-9d1df79cd73a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:31.017993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:31.018902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.019175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.019710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] PATH_INFO: `/v3/projects/1db77fcdce1143198fb360778bfd177a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.020675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db77fcdce1143198fb360778bfd177a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:31.022802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:31.040879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:31.051940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4884ec1-de3e-4e9f-9389-46c8c026b4f1 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:31.057580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:31.058537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.058783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.059253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] PATH_INFO: `/v3/users/6b0be96a63b748679a5b7c40e321649f` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.060503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b0be96a63b748679a5b7c40e321649f)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:31.062657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:31.093239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db77fcdce1143198fb360778bfd177a', 'request_id': 'req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.100810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db77fcdce1143198fb360778bfd177a', 'request_id': 'req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.115864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db77fcdce1143198fb360778bfd177a', 'request_id': 'req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.129045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b0be96a63b748679a5b7c40e321649f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.134993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] The token cache is being invalidate because project 1db77fcdce1143198fb360778bfd177a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:31.135283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.136239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.140733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 971/1935] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:30 2022] DELETE /identity/v3/projects/1db77fcdce1143198fb360778bfd177a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:31.144555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:31.149749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.151823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b0be96a63b748679a5b7c40e321649f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.166365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b0be96a63b748679a5b7c40e321649f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.167348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b0be96a63b748679a5b7c40e321649f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.175784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6d402aa1-93c8-418e-8ecc-5f9b3b864ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b0be96a63b748679a5b7c40e321649f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.185286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 965/1936] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:31 2022] DELETE /identity/v3/users/6b0be96a63b748679a5b7c40e321649f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:31.189628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.189919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.190198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.209680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:31.211231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.227505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbd5fd-15c6-40ef-b7a2-6ffd1002afdf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:31.232635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:31.280686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 966/1937] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:31.292694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:31.294573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.301610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:31.302825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.303615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.304063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] PATH_INFO: `/v3/users/1536f50ce66646309e8044fcab0fc52c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.305566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1536f50ce66646309e8044fcab0fc52c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:31.308219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:31.340161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:31.374779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1536f50ce66646309e8044fcab0fc52c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.387893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1536f50ce66646309e8044fcab0fc52c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.395336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dea7a-504f-4606-b262-9aa4e6d86d8b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:31.397830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1536f50ce66646309e8044fcab0fc52c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.399296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:31.399998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.400283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.400633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.407309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1536f50ce66646309e8044fcab0fc52c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.408208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1536f50ce66646309e8044fcab0fc52c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.411693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:31.413253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:31.415607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 972/1938] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:31 2022] DELETE /identity/v3/users/1536f50ce66646309e8044fcab0fc52c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:31.424827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 967/1939] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:31.737744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:31.739501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.774151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:31.775665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.793817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aac583-36b9-454a-abc6-619ae9b40c5d service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:31.833383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7d70a-ef15-4630-926c-2c15e1fc219b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:31.840122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:31.841643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.842180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.843976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] PATH_INFO: `/v3/projects/5728b3ba416e434ba244ae6c3a1d478e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.845290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5728b3ba416e434ba244ae6c3a1d478e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:31.847651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:31.863219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:31.864096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.864377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.864653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] PATH_INFO: `/v3/projects/b4599be79f35472d9a8700168bb4ab9d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.866057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4599be79f35472d9a8700168bb4ab9d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:31.868020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:31.887483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:31.902678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5728b3ba416e434ba244ae6c3a1d478e', 'request_id': 'req-ae5b48b2-f789-4f2f-816a-ae9f895496a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.909034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5728b3ba416e434ba244ae6c3a1d478e', 'request_id': 'req-ae5b48b2-f789-4f2f-816a-ae9f895496a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.917504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5728b3ba416e434ba244ae6c3a1d478e', 'request_id': 'req-ae5b48b2-f789-4f2f-816a-ae9f895496a4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.918168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4599be79f35472d9a8700168bb4ab9d', 'request_id': 'req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.925166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4599be79f35472d9a8700168bb4ab9d', 'request_id': 'req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.928217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] The token cache is being invalidate because project 5728b3ba416e434ba244ae6c3a1d478e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:31.928520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.929167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ae5b48b2-f789-4f2f-816a-ae9f895496a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.931738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 973/1940] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:31 2022] DELETE /identity/v3/projects/5728b3ba416e434ba244ae6c3a1d478e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:31.935036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4599be79f35472d9a8700168bb4ab9d', 'request_id': 'req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.936904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e875e4-9687-4ffc-9472-a20d0adefc01 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:31.937377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e875e4-9687-4ffc-9472-a20d0adefc01 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:31.937870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e875e4-9687-4ffc-9472-a20d0adefc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:31.950376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] The token cache is being invalidate because project b4599be79f35472d9a8700168bb4ab9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:31.950861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.951459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:31.956418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 968/1941] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:31 2022] DELETE /identity/v3/projects/b4599be79f35472d9a8700168bb4ab9d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:31.957468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:31.958389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-31e875e4-9687-4ffc-9472-a20d0adefc01 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:31.959538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:31.960288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-31e875e4-9687-4ffc-9472-a20d0adefc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.032283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 974/1942] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:32.039646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.040069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.040361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.051693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1ca0e2-c174-43a1-83c6-2d64621b21f2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.056676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.057571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.057894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.058118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] PATH_INFO: `/v3/users/88a2e506afdf460cbd017016dc025ecd` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.060084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88a2e506afdf460cbd017016dc025ecd)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.063075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.065508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:32.067112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.070322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:32.075787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 975/1943] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:32.079912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.090483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244c8ab-26e9-4d70-b81a-ae4ea9ff959c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.096903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670985-224a-4189-bc86-371df3110355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.097562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670985-224a-4189-bc86-371df3110355 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.097994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670985-224a-4189-bc86-371df3110355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.098402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76670985-224a-4189-bc86-371df3110355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.099179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670985-224a-4189-bc86-371df3110355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:32.100197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670985-224a-4189-bc86-371df3110355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.101845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76670985-224a-4189-bc86-371df3110355 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.119664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 976/1944] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:32.120624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670985-224a-4189-bc86-371df3110355 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.130250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76670985-224a-4189-bc86-371df3110355 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.134123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88a2e506afdf460cbd017016dc025ecd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.135732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.136413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.136752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.137064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.137842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.140159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.146855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88a2e506afdf460cbd017016dc025ecd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.156584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88a2e506afdf460cbd017016dc025ecd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.157629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88a2e506afdf460cbd017016dc025ecd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.168136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88a2e506afdf460cbd017016dc025ecd'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.174998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 969/1945] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:31 2022] DELETE /identity/v3/users/88a2e506afdf460cbd017016dc025ecd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:32.178400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 977/1946] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:32.179424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.181074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.251682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d726c5e-a122-4017-9d9d-23ab1729ee43 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.256334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.257003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.257282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.257553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.258268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.260250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.283377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 970/1947] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:32.287761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.353762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8e717-4b02-4d32-bff7-b2c717145021 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.358660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.359331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.359618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.359892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.360654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.362232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.376392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 978/1948] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:32.380422 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.391751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32460c0-5eac-4af8-a4b7-805ed96c9f34 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.397368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.398471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.398471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.398913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.399728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.401437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.412880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 971/1949] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:32.417060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.428265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec9282-37bb-4ce7-afe6-da8c0f04ee98 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.433281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c45af4-8fee-47fd-9347-5fd9e65ae65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.434165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c45af4-8fee-47fd-9347-5fd9e65ae65f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.434444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c45af4-8fee-47fd-9347-5fd9e65ae65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.434760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c45af4-8fee-47fd-9347-5fd9e65ae65f admin admin] PATH_INFO: `/v3/projects/2a36ce66699f43ab9b8c4cb6d6d45feb/users/167f9ef8952949e0b83a79c5003b9b2e/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.454629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:32.458364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c45af4-8fee-47fd-9347-5fd9e65ae65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a36ce66699f43ab9b8c4cb6d6d45feb, user_id=167f9ef8952949e0b83a79c5003b9b2e, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.461534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c45af4-8fee-47fd-9347-5fd9e65ae65f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.475996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.477907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.493290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 979/1950] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:32 2022] PUT /identity/v3/projects/2a36ce66699f43ab9b8c4cb6d6d45feb/users/167f9ef8952949e0b83a79c5003b9b2e/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:32.507216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.507521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.508043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.509569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ee04d-80d4-4dd7-8a8d-6a436b29b4b5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.546145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] MFA Rules not processed for user `167f9ef8952949e0b83a79c5003b9b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:32.547427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.593125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.594510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.594974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.597865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] PATH_INFO: `/v3/projects/cda909f991784899b15dcf429a22a84b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.601823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=cda909f991784899b15dcf429a22a84b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.604494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.621833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:32.680107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 980/1951] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:32.684117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.696737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cda909f991784899b15dcf429a22a84b', 'request_id': 'req-d12c555d-e6a9-4f71-af7b-709ac28d27ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.700686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9b158-f762-449a-ace3-f3d83baf5063 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.706439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cda909f991784899b15dcf429a22a84b', 'request_id': 'req-d12c555d-e6a9-4f71-af7b-709ac28d27ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.722044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cda909f991784899b15dcf429a22a84b', 'request_id': 'req-d12c555d-e6a9-4f71-af7b-709ac28d27ca'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.767741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] The token cache is being invalidate because project cda909f991784899b15dcf429a22a84b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:32.767982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.768882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d12c555d-e6a9-4f71-af7b-709ac28d27ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:32.775510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 972/1952] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:32 2022] DELETE /identity/v3/projects/cda909f991784899b15dcf429a22a84b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:32.778289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.778611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.778903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.794066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44791136-0618-40e6-a459-4c6d0cdb3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:32.795711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44791136-0618-40e6-a459-4c6d0cdb3a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.796988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44791136-0618-40e6-a459-4c6d0cdb3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.797395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44791136-0618-40e6-a459-4c6d0cdb3a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.798733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44791136-0618-40e6-a459-4c6d0cdb3a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:32.800997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44791136-0618-40e6-a459-4c6d0cdb3a6a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:32.827635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:32.834213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.865225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 981/1953] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/projects => generated 375 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:32.866881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:32.867426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:32.867761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:32.876307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 973/1954] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:32.877319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:32.878965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.890290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:32.891848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:32.903136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d4844-2656-46c9-924e-77bb01e59d18 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:32.986511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 982/1955] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:32.990790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.000073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:33.007437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931da7f5-df9f-4a4a-a1a0-0ecec0122b5b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.016588 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.017658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.018608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.019266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.020237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:33.034780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.042763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.060585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.061321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.061608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.061890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.071272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.078830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.081913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 983/1956] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:33.088780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.107015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83418b-af32-465f-a680-ab93e34d3139 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.113897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.114636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.114987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.115421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.116371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.118875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.151046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 974/1957] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:32 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:33.154455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.187672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d835413-dc39-4356-b178-e17849b19267 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.192542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.193751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.194247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.194823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.196727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.197711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.200566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 984/1958] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:33 2022] POST /identity/v3/projects => generated 393 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:33.205152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.232464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 975/1959] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:33.233748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.257493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53ab6fb-5ed6-4972-8219-b7173d75eb80 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.343763 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.345897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.346488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.347221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] PATH_INFO: `/v3/projects/d5f19d886b144ac3a2db2dc642cc6bf0/users/a59c4f009e83437793b23afed607abd0/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.384154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbed383-d9d7-4c09-b4e6-e954e8bfb54f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.386077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:33.401640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.404347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.405201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f19d886b144ac3a2db2dc642cc6bf0, user_id=a59c4f009e83437793b23afed607abd0, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.405567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.406783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.407699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.411891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.416942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.457739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 976/1960] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:33 2022] PUT /identity/v3/projects/d5f19d886b144ac3a2db2dc642cc6bf0/users/a59c4f009e83437793b23afed607abd0/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:33.462328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.486781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 985/1961] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:33 2022] POST /identity/v3/users => generated 297 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:33.489520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.518917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c338fa5-c5dc-4378-9e80-b19fb9377a7a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.613278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.614160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.614574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.615013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.615927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.618367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.639513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fddb988-105b-4e9c-9604-4b67a7bcb2f8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.645184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 986/1962] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:33.645864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.646977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.647518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.649586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.650271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.650386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.652151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.669674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 977/1963] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:33.673378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.677899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248b1705-c1d4-4377-9e06-ee1660e5a38b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.694856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.695607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.695894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.696172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.696921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.702874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.725546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72573b-327b-4ff3-9d73-c18c26fc40ae admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.732241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 987/1964] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:33.734675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.740680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66486620-10be-4662-a43d-521b7fb65d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.741968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486620-10be-4662-a43d-521b7fb65d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.742257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486620-10be-4662-a43d-521b7fb65d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.742622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66486620-10be-4662-a43d-521b7fb65d13 admin admin] PATH_INFO: `/v3/projects/d5f19d886b144ac3a2db2dc642cc6bf0/users/a59c4f009e83437793b23afed607abd0/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.744805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486620-10be-4662-a43d-521b7fb65d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f19d886b144ac3a2db2dc642cc6bf0, user_id=a59c4f009e83437793b23afed607abd0, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.747995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66486620-10be-4662-a43d-521b7fb65d13 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.758472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007942dc-185e-43fa-a9d3-1456d027a381 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:33.761616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 978/1965] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:33 2022] PUT /identity/v3/projects/d5f19d886b144ac3a2db2dc642cc6bf0/users/a59c4f009e83437793b23afed607abd0/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:33.774075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.774369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.774698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.809655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] MFA Rules not processed for user `a59c4f009e83437793b23afed607abd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:33.810886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:33.869902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:33.904775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 979/1966] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:33.908596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e748-7847-4a53-b21e-0ef396c1d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:33.910128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e748-7847-4a53-b21e-0ef396c1d5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.910128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e748-7847-4a53-b21e-0ef396c1d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.910575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e748-7847-4a53-b21e-0ef396c1d5c9 admin admin] PATH_INFO: `/v3/projects/c45d6391ecdf429582918941eb14ca2e/users/e1f734c696f44adea9ab5a4e36ffb0f4/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:33.932672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:33.935907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:33.945193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15e748-7847-4a53-b21e-0ef396c1d5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c45d6391ecdf429582918941eb14ca2e, user_id=e1f734c696f44adea9ab5a4e36ffb0f4, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:33.948724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15e748-7847-4a53-b21e-0ef396c1d5c9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:33.974463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 988/1967] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:33 2022] PUT /identity/v3/projects/c45d6391ecdf429582918941eb14ca2e/users/e1f734c696f44adea9ab5a4e36ffb0f4/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:33.987564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:33.987764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:33.988176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.029570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605684a-bc94-4027-bc06-1653e2c89f07 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.031380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] MFA Rules not processed for user `e1f734c696f44adea9ab5a4e36ffb0f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:34.033013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:34.045008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:34.113758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.114745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.115283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.115830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.117904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:34.150509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 989/1968] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:34.155711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.201859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.203749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.217531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 980/1969] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:34.284374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d88f7-e45e-46e7-9216-764c16925ce2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.292365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.294869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.295499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.296966 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.298099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.301347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.346150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 990/1970] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:34 2022] POST /identity/v3/projects => generated 391 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:34.347492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.362716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc080bb-bbe1-4e2c-8345-deff644c90ad service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.439260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.439783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.440054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.440331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.441020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.442993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.472416 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 981/1971] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:34 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:34.477260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.490311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da36a6-632e-459a-a35b-cb819530174c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.497305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.497754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.498290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.498409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.499260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.501322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.515735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 991/1972] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:34.521854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.535366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0561f6e9-7fb9-4001-8a31-d398e116438f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.542451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.543631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.546174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.546497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] PATH_INFO: `/v3/projects/c9bf5b77f9504828bb55360de7b916eb/users/6efcc499619647c1ba3ec2acdd4e24ec/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.565418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bf5b77f9504828bb55360de7b916eb, user_id=6efcc499619647c1ba3ec2acdd4e24ec, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.568221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.586455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 982/1973] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:34 2022] PUT /identity/v3/projects/c9bf5b77f9504828bb55360de7b916eb/users/6efcc499619647c1ba3ec2acdd4e24ec/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:34.588937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.609874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c75b34-fb43-4eb1-94a2-bd97e470510b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.655509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:34.688993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21233b6d-9ef7-4d37-b27a-047746e25281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.689750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21233b6d-9ef7-4d37-b27a-047746e25281 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.690101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21233b6d-9ef7-4d37-b27a-047746e25281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.690482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21233b6d-9ef7-4d37-b27a-047746e25281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.691291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21233b6d-9ef7-4d37-b27a-047746e25281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.693341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21233b6d-9ef7-4d37-b27a-047746e25281 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.704367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 992/1974] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:34.708635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.719835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1544b18-6dfe-4945-87fe-bffea849faef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.724807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.725777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.726063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.726372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] PATH_INFO: `/v3/projects/c9bf5b77f9504828bb55360de7b916eb/users/6efcc499619647c1ba3ec2acdd4e24ec/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.728542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bf5b77f9504828bb55360de7b916eb, user_id=6efcc499619647c1ba3ec2acdd4e24ec, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.731284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:34.742039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 983/1975] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:34 2022] PUT /identity/v3/projects/c9bf5b77f9504828bb55360de7b916eb/users/6efcc499619647c1ba3ec2acdd4e24ec/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:34.752344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.752662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.752945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.780834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] MFA Rules not processed for user `6efcc499619647c1ba3ec2acdd4e24ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:34.782195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:34.874097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 993/1976] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:34.885982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:34.913250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:34.958560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d855bf-e63b-4c9c-9702-9068495df226 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:34.963491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:34.964497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:34.965059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:34.965342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:34.981488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:34.988682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:35.001359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 984/1977] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:35.064159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:35.090460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21944-c0a4-4702-9562-ef424876a7c5 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:35.107678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:35.108944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:35.109329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:35.109716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:35.263720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:35.265784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:35.292970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 994/1978] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:40.305982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:40.307543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:40.321345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e881fc-c091-4afe-b874-311dfdd35086 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:40.329302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45163a35-6ebf-4f35-833c-a90b6de09f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:40.330098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163a35-6ebf-4f35-833c-a90b6de09f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:40.330470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163a35-6ebf-4f35-833c-a90b6de09f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:40.330821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45163a35-6ebf-4f35-833c-a90b6de09f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:40.435547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163a35-6ebf-4f35-833c-a90b6de09f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:40.437160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45163a35-6ebf-4f35-833c-a90b6de09f1c service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:40.448418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 985/1979] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:41.033824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:41.095062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:41.111641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a433e535-14fa-48a4-be53-147f068a94d4 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:41.116921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:41.117916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.118198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.118510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] PATH_INFO: `/v3/users/e1f734c696f44adea9ab5a4e36ffb0f4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.119701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f734c696f44adea9ab5a4e36ffb0f4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:41.121677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:41.178364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f734c696f44adea9ab5a4e36ffb0f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.198949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f734c696f44adea9ab5a4e36ffb0f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.208143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f734c696f44adea9ab5a4e36ffb0f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.218123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f734c696f44adea9ab5a4e36ffb0f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.218940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f734c696f44adea9ab5a4e36ffb0f4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.225470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 995/1980] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:41 2022] DELETE /identity/v3/users/e1f734c696f44adea9ab5a4e36ffb0f4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:41.230083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.230451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.230790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.248138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:41.249427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.312544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 986/1981] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:41.322627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:41.324207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.392624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677eb3c-b85e-465a-a0a7-afbadd589870 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:41.396930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:41.397635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.397987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.398336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.407960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:41.409395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:41.419212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 996/1982] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:41.632639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:41.634135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.650505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1535f-7c53-4efd-94a4-5b43d5c25611 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:41.656017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:41.657006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.657366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.657776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] PATH_INFO: `/v3/users/96ee15bbf28f4b24b7a04203e05434c6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.659120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ee15bbf28f4b24b7a04203e05434c6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:41.661131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:41.731662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:41.732995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.742058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ee15bbf28f4b24b7a04203e05434c6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.749803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:41.753668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528193a4-efaf-44c6-bca8-6f2f305d9028 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:41.767288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:41.768591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ee15bbf28f4b24b7a04203e05434c6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.768939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.769423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.770011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] PATH_INFO: `/v3/projects/c45d6391ecdf429582918941eb14ca2e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.772280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c45d6391ecdf429582918941eb14ca2e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:41.775062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:41.778631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ee15bbf28f4b24b7a04203e05434c6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.779400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ee15bbf28f4b24b7a04203e05434c6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.789396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-79fd91c0-44a4-46c6-808e-e1f2897b793d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ee15bbf28f4b24b7a04203e05434c6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.798513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 987/1983] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:41 2022] DELETE /identity/v3/users/96ee15bbf28f4b24b7a04203e05434c6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:41.804723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.805224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.806732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.828314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:41.829561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.832761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c45d6391ecdf429582918941eb14ca2e', 'request_id': 'req-5b8ce691-55c9-4b6e-bb42-231f82f7137f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.840770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c45d6391ecdf429582918941eb14ca2e', 'request_id': 'req-5b8ce691-55c9-4b6e-bb42-231f82f7137f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.853716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c45d6391ecdf429582918941eb14ca2e', 'request_id': 'req-5b8ce691-55c9-4b6e-bb42-231f82f7137f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.861177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:41.871140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] The token cache is being invalidate because project c45d6391ecdf429582918941eb14ca2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:41.872652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.872652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:41.874919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 997/1984] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:41 2022] DELETE /identity/v3/projects/c45d6391ecdf429582918941eb14ca2e => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:41.879305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:41.881271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.906296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 988/1985] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:41.912784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:41.915045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:41.981000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ce691-55c9-4b6e-bb42-231f82f7137f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:41.981410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ce5482-49df-4e83-b89a-67e550cb1dd3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:41.985492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:41.986179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.986692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.986978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.987393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:41.988484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:41.988927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:41.989439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] PATH_INFO: `/v3/users/6efcc499619647c1ba3ec2acdd4e24ec` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:41.991170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efcc499619647c1ba3ec2acdd4e24ec)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:41.993251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.001318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.002960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.017522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 989/1986] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:42.070665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efcc499619647c1ba3ec2acdd4e24ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.092689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efcc499619647c1ba3ec2acdd4e24ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.107342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efcc499619647c1ba3ec2acdd4e24ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.116938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efcc499619647c1ba3ec2acdd4e24ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.117821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efcc499619647c1ba3ec2acdd4e24ec'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.127884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 998/1987] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:41 2022] DELETE /identity/v3/users/6efcc499619647c1ba3ec2acdd4e24ec => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:42.444817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:42.446331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:42.461940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3b4c1-b9c6-4793-a3d8-1357df2ce81d service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:42.531077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:42.531950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.532229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.532503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] PATH_INFO: `/v3/projects/d3cca5ff78ef46ebb422a667a15ee79d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.534342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3cca5ff78ef46ebb422a667a15ee79d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.535838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.557145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:42.576192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:42.577394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:42.600009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e3024-244a-4bad-a633-bc09d3ed75a9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:42.600754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3cca5ff78ef46ebb422a667a15ee79d', 'request_id': 'req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.608797 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3cca5ff78ef46ebb422a667a15ee79d', 'request_id': 'req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.622022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3cca5ff78ef46ebb422a667a15ee79d', 'request_id': 'req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.635591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] The token cache is being invalidate because project d3cca5ff78ef46ebb422a667a15ee79d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:42.635885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.636538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3a5337e7-2f40-4f57-bae8-f11a93d99ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.638383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 990/1988] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:42 2022] DELETE /identity/v3/projects/d3cca5ff78ef46ebb422a667a15ee79d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:42.644010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed6dbf-1758-4ee9-9f1a-a3a0c48dc8d0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.644374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed6dbf-1758-4ee9-9f1a-a3a0c48dc8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.644764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed6dbf-1758-4ee9-9f1a-a3a0c48dc8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.666314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-10ed6dbf-1758-4ee9-9f1a-a3a0c48dc8d0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:42.667596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-10ed6dbf-1758-4ee9-9f1a-a3a0c48dc8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:42.679533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:42.680509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.680910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.681043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] PATH_INFO: `/v3/projects/c9bf5b77f9504828bb55360de7b916eb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.682243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bf5b77f9504828bb55360de7b916eb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.684234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.702114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:42.738257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bf5b77f9504828bb55360de7b916eb', 'request_id': 'req-965ef1a1-0615-491c-81dc-27c99081f773'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.741680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 991/1989] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:42.746573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bf5b77f9504828bb55360de7b916eb', 'request_id': 'req-965ef1a1-0615-491c-81dc-27c99081f773'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.751147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.751682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.751958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.755874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bf5b77f9504828bb55360de7b916eb', 'request_id': 'req-965ef1a1-0615-491c-81dc-27c99081f773'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.767581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] The token cache is being invalidate because project c9bf5b77f9504828bb55360de7b916eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:42.768164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.768700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-965ef1a1-0615-491c-81dc-27c99081f773 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:42.774040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 999/1990] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:42 2022] DELETE /identity/v3/projects/c9bf5b77f9504828bb55360de7b916eb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:42.774208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:42.774208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:42.775619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed231db-c1c7-4483-b405-cd1ee8625691 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.775992 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed231db-c1c7-4483-b405-cd1ee8625691 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.776386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed231db-c1c7-4483-b405-cd1ee8625691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.799010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-7ed231db-c1c7-4483-b405-cd1ee8625691 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:42.800421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7ed231db-c1c7-4483-b405-cd1ee8625691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:42.848373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 992/1991] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:42.853407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:42.864562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b9889-2122-4f3a-8dcb-f8d2d8a371ae None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:42.869042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1000/1992] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:42.877432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.877727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.878127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.879162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:42.880116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.880875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.881529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.882999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:42.883720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.885626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.899773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:42.901040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:42.903025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 993/1993] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:58:42.907683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:42.910287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1001/1994] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:42.915594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:42.926576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8749aa7-646c-4150-bd2d-cecdc43b712e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:42.926847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3aaac-adf1-4a00-8125-62934b85c803 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:42.932448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:42.933266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.933641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.934039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.935100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:42.935499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.936999 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:42.937639 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.937981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.948761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.949951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.951454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.953953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1002/1995] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:58:42.954606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.963235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:42.979952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e86a79a-3511-4e8c-a544-c401c3b115db admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:42.987830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:42.988614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:42.988895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:42.989221 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:42.990011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:42.992170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:42.995427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 994/1996] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.000180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.012548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:43.033608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1003/1997] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/projects => generated 379 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.038675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.092665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b965303-a290-473d-b4fa-b0f14a1c7ee1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.125161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77aae5-7d7b-47b5-9f47-e4033a8f9763 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.132663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.133548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.134292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.134682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.136032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.144572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.158684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:43.186816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1004/1998] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.188951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.188951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.188951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.188951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.189709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.191423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.191721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.202438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563143b-9948-4ead-844b-4ca27be468ea admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.207443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.208210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.208871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.209229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.210161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.212075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.223435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 995/1999] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:42 2022] POST /identity/v3/users => generated 293 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.223669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1005/2000] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:43.225267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.227195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.236477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54268335-3c61-4bae-9bc9-1f0e769c6000 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.237431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858dd9a-b4ed-4283-a4a4-c9275c266fc9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.242371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.242654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.243092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.243337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.243451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.243664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.243779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.243927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.244357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.244752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.245955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.246324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.261420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 996/2001] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:43.261608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1006/2002] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:43.262524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.264204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.273367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6bce7e-ad87-49a0-8aaf-4e515cc7c058 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.275158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a17aa-c76d-4e38-baa8-9e4476a18e3b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.278892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.279676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.279802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f0ff1-2672-40d7-a046-7dd7c6ebf31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.280116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.280502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.280687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f0ff1-2672-40d7-a046-7dd7c6ebf31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.280968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f0ff1-2672-40d7-a046-7dd7c6ebf31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.281269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f0ff1-2672-40d7-a046-7dd7c6ebf31e admin admin] PATH_INFO: `/v3/projects/86b1818b27cf4a20897cca54d4389968/users/0339a5fa3d884ef1b7a8023eb588bd11/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.281369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.282950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.297325 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f0ff1-2672-40d7-a046-7dd7c6ebf31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b1818b27cf4a20897cca54d4389968, user_id=0339a5fa3d884ef1b7a8023eb588bd11, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.301890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 997/2003] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:43.302104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f0ff1-2672-40d7-a046-7dd7c6ebf31e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.303788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.315192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23627673-357a-4cf1-ac12-14ccccec36b7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.321941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1007/2004] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:43 2022] PUT /identity/v3/projects/86b1818b27cf4a20897cca54d4389968/users/0339a5fa3d884ef1b7a8023eb588bd11/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:43.327215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.327774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.328071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.360265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] MFA Rules not processed for user `0339a5fa3d884ef1b7a8023eb588bd11`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:43.361414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:43.392498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae0939-ab93-46fe-af62-a09b0ff9bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.393512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0939-ab93-46fe-af62-a09b0ff9bdd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.394216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0939-ab93-46fe-af62-a09b0ff9bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.394216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae0939-ab93-46fe-af62-a09b0ff9bdd0 admin admin] PATH_INFO: `/v3/projects/7d8d1a19f2fd45738e37879f42db9e36/users/776df7f120e1411ba9aaa5ccd96ea4ed/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.412778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae0939-ab93-46fe-af62-a09b0ff9bdd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d8d1a19f2fd45738e37879f42db9e36, user_id=776df7f120e1411ba9aaa5ccd96ea4ed, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.415487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ae0939-ab93-46fe-af62-a09b0ff9bdd0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.432281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 998/2005] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:43 2022] PUT /identity/v3/projects/7d8d1a19f2fd45738e37879f42db9e36/users/776df7f120e1411ba9aaa5ccd96ea4ed/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:43.442912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.443664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.443864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.453845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1008/2006] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:43.456799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:43.459738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.471381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6da326-6d15-4055-985a-876a7afc0337 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.473749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] MFA Rules not processed for user `776df7f120e1411ba9aaa5ccd96ea4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:43.475075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:43.537112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.538600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.538960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.539305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.540084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.542299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.550245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 999/2007] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:43.555185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.566952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0ebb1-e1f0-41f3-9fd1-55ff2d5793c0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.572537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.573237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.573522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.573800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.574515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.576426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.580331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1009/2008] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.582383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.609637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1000/2009] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:43.612214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:43.614364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.657036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c905a20-f01c-4b53-8493-d434b025f90b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.685177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11124a4a-735c-4853-9f09-039e9a99e66e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.690251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.691152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.691549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.691904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.692762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.695361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.722174 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1001/2010] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.722723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.722873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.723151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.723427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.723615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.724297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.726597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.734891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a86485-84b3-4939-a633-2455d408582e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.742036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.742835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.743119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.743454 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.744318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.746286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.750251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1010/2011] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:43.754844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.762161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1002/2012] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:43.763480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.770925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bee15-1cfc-49b4-86a6-f404d51c0df7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.776014 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81c846-83c3-4e4d-b4e9-c04286b4cf39 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.776350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.777036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.777326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.777624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.778506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.780079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.781599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.782242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.782579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.782858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.783620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.785509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.794488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1011/2013] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:43.797958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.798569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1003/2014] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:43.802907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.810938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cccd394-2e6b-414f-9e2d-d87715559a38 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.813453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396e1dd-5865-4ace-8918-da2392a88ebc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.815734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.816446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.816727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.817001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.818113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.819191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dceaf86-ca7b-4684-9c0e-07e29548e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.819895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.820121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceaf86-ca7b-4684-9c0e-07e29548e202 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.820403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceaf86-ca7b-4684-9c0e-07e29548e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.820682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dceaf86-ca7b-4684-9c0e-07e29548e202 admin admin] PATH_INFO: `/v3/projects/818a75d094cd4bc9aa4f8b53b320f120/users/ca162a5b295448d086e163d41827bf24/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.831892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1012/2015] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:43.836120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:43.841260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceaf86-ca7b-4684-9c0e-07e29548e202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818a75d094cd4bc9aa4f8b53b320f120, user_id=ca162a5b295448d086e163d41827bf24, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.844173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dceaf86-ca7b-4684-9c0e-07e29548e202 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.848100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05501c-ac0b-4918-8ca0-81a6b7eacca4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:43.857528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93117c95-c058-41d7-b45f-f8f365283978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:43.859116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117c95-c058-41d7-b45f-f8f365283978 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.859586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117c95-c058-41d7-b45f-f8f365283978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.860064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117c95-c058-41d7-b45f-f8f365283978 admin admin] PATH_INFO: `/v3/projects/c7563944d2b047f8a1cbfca289f3217a/users/b43117c5e20f4b348fdd1f5f65d2d67a/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.866648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1004/2016] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:43 2022] PUT /identity/v3/projects/818a75d094cd4bc9aa4f8b53b320f120/users/ca162a5b295448d086e163d41827bf24/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:43.877430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.877807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.878187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.883815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117c95-c058-41d7-b45f-f8f365283978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7563944d2b047f8a1cbfca289f3217a, user_id=b43117c5e20f4b348fdd1f5f65d2d67a, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:43.886691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117c95-c058-41d7-b45f-f8f365283978 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:43.907884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1013/2017] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:43 2022] PUT /identity/v3/projects/c7563944d2b047f8a1cbfca289f3217a/users/b43117c5e20f4b348fdd1f5f65d2d67a/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:43.914211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] MFA Rules not processed for user `ca162a5b295448d086e163d41827bf24`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:43.915759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:43.918633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:43.919366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:43.919678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:43.922936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:43.950090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] MFA Rules not processed for user `b43117c5e20f4b348fdd1f5f65d2d67a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:43.951348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:43.994465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1005/2018] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:43.999511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.027757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1014/2019] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:44.032373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.037524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:44.076771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c5c02-d4bb-4e80-8207-1471440f900e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.081551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.082625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.083051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.083543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.084409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.086945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.124258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1006/2020] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:43 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:44.127686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.134381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c44d5e-2f94-452b-9f63-fd07692ed23d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.227146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6719f0ae-b3f1-4380-9f92-62dbcb2431b4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.233998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.234963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.235319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.235848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.236715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.239416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.239683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.240266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.240556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.240835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.241545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.248005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.270934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1007/2021] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:44 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:44.275166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.292386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b6d445-51d3-4c19-96a0-1a48ea8d73ef admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.298770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.299456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.300241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.300522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.301265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.303646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.308890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1015/2022] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:44 2022] POST /identity/v3/projects => generated 377 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:44.313096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.327238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1008/2023] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:44.327468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.345484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80eb50e-4690-4fad-abaf-482d04d93040 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.359246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:44.411939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822a765-11dc-46e6-9321-210a762db222 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.416983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.417660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.417941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.418215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.418944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.421012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.440012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.441051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.441486 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.441773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] PATH_INFO: `/v3/projects/9af27034f6234fc9b9c34bace4220ac8/users/1155ebe55f5e45b78d95fbe18fa5fad2/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.450652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1016/2024] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:44 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:44.452210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.460436 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af27034f6234fc9b9c34bace4220ac8, user_id=1155ebe55f5e45b78d95fbe18fa5fad2, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.463051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.463621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57628775-3adc-415e-be2a-be15b829118f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.469654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.470625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.470964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.471246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.472254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.475057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.479122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1009/2025] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:44 2022] PUT /identity/v3/projects/9af27034f6234fc9b9c34bace4220ac8/users/1155ebe55f5e45b78d95fbe18fa5fad2/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:44.482932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.489373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1017/2026] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:44.490540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.501216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52665e66-064e-4eef-b82c-8d68a26ea644 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.511418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:44.556147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cad60-c15b-40bf-a894-9ed9b606a210 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.562232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.562925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.563206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.563490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.564219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.565859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.568886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.569808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.570094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.570375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] PATH_INFO: `/v3/projects/41bce630ef814f9f921aaaf71b31c748/users/0b76f36eb801442f940761bec60241a5/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.579646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1010/2027] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:44.583372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.588439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bce630ef814f9f921aaaf71b31c748, user_id=0b76f36eb801442f940761bec60241a5, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.591315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.594340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780da2dd-ff61-4942-8cf6-0e05872bc6a5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.601734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ae957-5ed4-4a26-8a37-362cd2d313fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.602815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae957-5ed4-4a26-8a37-362cd2d313fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.603369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae957-5ed4-4a26-8a37-362cd2d313fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.603702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ae957-5ed4-4a26-8a37-362cd2d313fd admin admin] PATH_INFO: `/v3/projects/9af27034f6234fc9b9c34bace4220ac8/users/1155ebe55f5e45b78d95fbe18fa5fad2/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.605865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ae957-5ed4-4a26-8a37-362cd2d313fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af27034f6234fc9b9c34bace4220ac8, user_id=1155ebe55f5e45b78d95fbe18fa5fad2, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.606444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1018/2028] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:44 2022] PUT /identity/v3/projects/41bce630ef814f9f921aaaf71b31c748/users/0b76f36eb801442f940761bec60241a5/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:44.608728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ae957-5ed4-4a26-8a37-362cd2d313fd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.611422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.621693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1011/2029] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:44 2022] PUT /identity/v3/projects/9af27034f6234fc9b9c34bace4220ac8/users/1155ebe55f5e45b78d95fbe18fa5fad2/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:44.633186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.633404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.633668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.662915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] MFA Rules not processed for user `1155ebe55f5e45b78d95fbe18fa5fad2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:44.664317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:44.677688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba04c9-caca-42e3-b19a-5e4b936c6b54 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.736113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.736813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.737148 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.737519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.737627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1012/2030] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:44.738167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.739931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.748757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.750461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:44.750934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1019/2031] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:44.755601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.756015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:44.765907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe729b2-ed91-46de-85cc-072c39ba059f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.770396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d13fae-1d00-4412-b021-59e575750a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.771352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d13fae-1d00-4412-b021-59e575750a30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.771638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d13fae-1d00-4412-b021-59e575750a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.771906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d13fae-1d00-4412-b021-59e575750a30 admin admin] PATH_INFO: `/v3/projects/41bce630ef814f9f921aaaf71b31c748/users/0b76f36eb801442f940761bec60241a5/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.773867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d13fae-1d00-4412-b021-59e575750a30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41bce630ef814f9f921aaaf71b31c748, user_id=0b76f36eb801442f940761bec60241a5, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.776502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d13fae-1d00-4412-b021-59e575750a30 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.786847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1020/2032] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:44 2022] PUT /identity/v3/projects/41bce630ef814f9f921aaaf71b31c748/users/0b76f36eb801442f940761bec60241a5/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:44.798326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.798638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.798914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.811504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac7104c-937d-44ab-ab40-d01e3a8e80bd None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.826172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] MFA Rules not processed for user `0b76f36eb801442f940761bec60241a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:44.827459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:44.841674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:44.864152 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.865096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.865411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.865692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.905784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1021/2033] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:44.917298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:44.918768 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:44.924854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.926288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.930933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f529d19-d4f1-4156-9d8d-189ff121d7cf None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:44.934750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:44.935410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:44.935754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:44.936038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:44.936463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1013/2034] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:58:44.949158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:44.950714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:44.964919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1022/2035] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:45.003063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:45.012411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd0b85-8105-4556-aeab-9f674920e492 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:45.016479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:45.017134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:45.017417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:45.017696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:45.084647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:45.086193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:45.098210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1014/2036] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:46.518744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:46.535493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfce4d9-371f-4365-9bdd-f3013ba75837 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:46.540365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276284c-1643-4afc-9861-cc7747e48ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:46.541042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276284c-1643-4afc-9861-cc7747e48ddd service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:46.541313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276284c-1643-4afc-9861-cc7747e48ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:46.541607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276284c-1643-4afc-9861-cc7747e48ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:46.611682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:46.613647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:46.628288 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276284c-1643-4afc-9861-cc7747e48ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:46.630180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276284c-1643-4afc-9861-cc7747e48ddd service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:46.635692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:46.677194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1023/2037] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:46.831796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4973cab-1bb0-4034-9cbd-0484c9c1b631 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:46.839215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:46.840601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:46.840888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:46.841740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] PATH_INFO: `/v3/users/587b25657adf404c83518a81f35f933e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:46.843614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] RBAC: Authorizing `identity:delete_user(user_id=587b25657adf404c83518a81f35f933e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:46.846336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:46.951291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '587b25657adf404c83518a81f35f933e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:46.986190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '587b25657adf404c83518a81f35f933e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:46.999181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '587b25657adf404c83518a81f35f933e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:46.999959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '587b25657adf404c83518a81f35f933e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:47.028451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '587b25657adf404c83518a81f35f933e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:47.043846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1015/2038] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:46 2022] DELETE /identity/v3/users/587b25657adf404c83518a81f35f933e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:47.048682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:47.049055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:47.049867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:47.076725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:47.077927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:47.231204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1024/2039] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:47.275251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:47.276947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:47.386336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00955f-f6a0-478f-ac7a-26719da3314c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:47.390710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:47.391376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:47.391726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:47.391929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:47.402865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:47.404259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:47.424945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1016/2040] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:47.670759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:47.672167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:47.717721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:47.734086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4edb80-db95-464a-86eb-8f564f9663a0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:47.737600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:47.738257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:47.738578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:47.738862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:47.740773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:47.808607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:47.810016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d46b1d4-9ddc-45bb-ac8f-7e7b3c8db7a6 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:47.820195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1025/2041] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:47 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:48.256223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.257990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:48.273334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6510c-064e-423f-98a4-87dab601300c service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.280034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.281176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.281737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.282319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] PATH_INFO: `/v3/projects/5dc5a285ee3648b6801039bfb32fd41e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.283639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc5a285ee3648b6801039bfb32fd41e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.287141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.334290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:48.352641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc5a285ee3648b6801039bfb32fd41e', 'request_id': 'req-c8ed7386-17ad-4c35-88d6-64951adc9350'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:48.359575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc5a285ee3648b6801039bfb32fd41e', 'request_id': 'req-c8ed7386-17ad-4c35-88d6-64951adc9350'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:48.377251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc5a285ee3648b6801039bfb32fd41e', 'request_id': 'req-c8ed7386-17ad-4c35-88d6-64951adc9350'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:48.391506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] The token cache is being invalidate because project 5dc5a285ee3648b6801039bfb32fd41e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:48.391795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:48.392485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c8ed7386-17ad-4c35-88d6-64951adc9350 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:48.394052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1017/2042] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:48 2022] DELETE /identity/v3/projects/5dc5a285ee3648b6801039bfb32fd41e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:48.400041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.400702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.400984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.419436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:48.420626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:48.483549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1026/2043] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:48.491372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.491662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.492070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.510726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:48.511958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:48.520276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1018/2044] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:48.524855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.535470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ec96e-07af-4b87-a49b-32190fb7c094 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.540559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.541256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.541541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.541825 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.542583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:48.542891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.544512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.557144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1027/2045] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:58:48.561651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.571655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d9fa29-af69-4f90-bafe-e251a39bf547 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.577189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.578020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.578472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.579041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.579880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.581833 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.614899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1019/2046] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:48 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:48.616300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.626296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c2b55-e0a8-412a-809b-bfd080d15d29 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.695208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.695893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.696159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.696432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.697114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.699065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.723397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1028/2047] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:48 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:48.724751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.735282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ae3533-9021-4ec4-b9fc-07c62c9b93e0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.740473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.741140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.741419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.741782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.742554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.744173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.758494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1020/2048] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:48.761037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.770574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:48.775392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cac2fa-a7e9-44e7-baf9-f4bfaee2bf02 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.782147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23804b1-58f4-4655-889f-5a4f21f80af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.783331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23804b1-58f4-4655-889f-5a4f21f80af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.783690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23804b1-58f4-4655-889f-5a4f21f80af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.784038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23804b1-58f4-4655-889f-5a4f21f80af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.784927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23804b1-58f4-4655-889f-5a4f21f80af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.786729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23804b1-58f4-4655-889f-5a4f21f80af4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.803371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1029/2049] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:48.804485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.814814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2b863-321d-4b5d-b864-89a571814c3a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:48.820212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:48.821107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.821410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.821680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] PATH_INFO: `/v3/projects/169fb46470a04288b947bd729540099b/users/996f767ef6e843ffa49b893ddd832889/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.840255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169fb46470a04288b947bd729540099b, user_id=996f767ef6e843ffa49b893ddd832889, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:48.842930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:48.856752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1021/2050] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:48 2022] PUT /identity/v3/projects/169fb46470a04288b947bd729540099b/users/996f767ef6e843ffa49b893ddd832889/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:48.861591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:48.861884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:48.862187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:48.880561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:48.881832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:48.946711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1030/2051] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:48.956497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:48.959161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:49.020133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691157-bca9-469a-99fe-083a384e9289 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:49.024386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea81368-38dd-441f-84c8-da28e75b46be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:49.025064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81368-38dd-441f-84c8-da28e75b46be service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:49.025349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81368-38dd-441f-84c8-da28e75b46be service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:49.025629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81368-38dd-441f-84c8-da28e75b46be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:49.036006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea81368-38dd-441f-84c8-da28e75b46be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:49.038017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea81368-38dd-441f-84c8-da28e75b46be service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:49.048136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1022/2052] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:51.994603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:51.997030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:52.020432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1ceb6-24c3-4a3e-b31d-5549a0966767 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:52.032315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:52.033628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:52.034114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:52.034628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] PATH_INFO: `/v3/users/0339a5fa3d884ef1b7a8023eb588bd11` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:52.036086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0339a5fa3d884ef1b7a8023eb588bd11)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:52.040542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:52.146271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0339a5fa3d884ef1b7a8023eb588bd11'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:52.177454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0339a5fa3d884ef1b7a8023eb588bd11'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:52.192464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0339a5fa3d884ef1b7a8023eb588bd11'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:52.216739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0339a5fa3d884ef1b7a8023eb588bd11'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:52.222654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0339a5fa3d884ef1b7a8023eb588bd11'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:52.231510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1031/2053] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:51 2022] DELETE /identity/v3/users/0339a5fa3d884ef1b7a8023eb588bd11 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:52.235765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:52.236302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:52.236302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:52.270721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:52.271994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:52.408622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:52.447274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1023/2054] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:52.482256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:52.484182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:52.685919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9559cba-50db-4c93-ba0c-e7f4f366b6b9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:52.699980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:52.700544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:52.700893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:52.701252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:52.737952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:52.740998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:52.774886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1032/2055] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:53.281359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:53.282864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:53.309809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c28bf7-94c6-47f5-979c-66fb1e2c3a76 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:53.315635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:53.317212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:53.317764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:53.318522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] PATH_INFO: `/v3/projects/86b1818b27cf4a20897cca54d4389968` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:53.320363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b1818b27cf4a20897cca54d4389968)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:53.322959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:53.392310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b1818b27cf4a20897cca54d4389968', 'request_id': 'req-7de4d790-7098-44ec-b782-2efa529d6dbc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.399407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b1818b27cf4a20897cca54d4389968', 'request_id': 'req-7de4d790-7098-44ec-b782-2efa529d6dbc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.424338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b1818b27cf4a20897cca54d4389968', 'request_id': 'req-7de4d790-7098-44ec-b782-2efa529d6dbc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.439711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] The token cache is being invalidate because project 86b1818b27cf4a20897cca54d4389968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:53.440004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.441073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.443769 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1024/2056] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:53 2022] DELETE /identity/v3/projects/86b1818b27cf4a20897cca54d4389968 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:53.447912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:53.460444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4f5fc0-9a88-4056-827f-de7c82430c6f service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:53.466695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:53.557896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:53.559660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:53.560532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:53.560978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] PATH_INFO: `/v3/users/b43117c5e20f4b348fdd1f5f65d2d67a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:53.562512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43117c5e20f4b348fdd1f5f65d2d67a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:53.564797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:53.653677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43117c5e20f4b348fdd1f5f65d2d67a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.675426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43117c5e20f4b348fdd1f5f65d2d67a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.686098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43117c5e20f4b348fdd1f5f65d2d67a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.695302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43117c5e20f4b348fdd1f5f65d2d67a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.696330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43117c5e20f4b348fdd1f5f65d2d67a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:53.705358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1033/2057] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:53 2022] DELETE /identity/v3/users/b43117c5e20f4b348fdd1f5f65d2d67a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:54.421515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:54.435140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:54.466465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d790-7098-44ec-b782-2efa529d6dbc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:54.535788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:54.536791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:54.537126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:54.537411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] PATH_INFO: `/v3/projects/c7563944d2b047f8a1cbfca289f3217a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:54.538743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7563944d2b047f8a1cbfca289f3217a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:54.540917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:54.609978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7563944d2b047f8a1cbfca289f3217a', 'request_id': 'req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.617636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7563944d2b047f8a1cbfca289f3217a', 'request_id': 'req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.628165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7563944d2b047f8a1cbfca289f3217a', 'request_id': 'req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.642283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] The token cache is being invalidate because project c7563944d2b047f8a1cbfca289f3217a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:54.642631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.647342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2f981e55-99c3-4ff6-ab8a-6ae876d2194e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.649099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1025/2058] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:54 2022] DELETE /identity/v3/projects/c7563944d2b047f8a1cbfca289f3217a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:54.653391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:54.655240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:54.672499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69cb5-804b-4e70-86e0-aaaa6e18a1b4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:54.764000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:54.765282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:54.765569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:54.766331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] PATH_INFO: `/v3/users/0b76f36eb801442f940761bec60241a5` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:54.768137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b76f36eb801442f940761bec60241a5)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:54.770587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:54.826778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:54.855079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b76f36eb801442f940761bec60241a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.869389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b76f36eb801442f940761bec60241a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.880351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b76f36eb801442f940761bec60241a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.890286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b76f36eb801442f940761bec60241a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.891098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b76f36eb801442f940761bec60241a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:54.897972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1034/2059] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:54 2022] DELETE /identity/v3/users/0b76f36eb801442f940761bec60241a5 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:54.922093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:54.923349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:54.924124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:54.949233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:54.963170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] MFA Rules not processed for user `996f767ef6e843ffa49b893ddd832889`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:54.965731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:55.051719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1026/2060] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:55.056356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.058179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:55.157982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d01f28-117e-4dd6-8303-adc3909c6e7a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.163668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.164324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.165150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.165150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.165916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.168401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.207100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1035/2061] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:55 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:55.212098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.232263 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a64998-f3f2-406d-ab51-0bb1b4705a74 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.321129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.322096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.322337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.322754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.323455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.326738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.328399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.330299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:55.346514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394f82f-c6ed-41e4-9e5b-fb597c72ad16 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.356199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1027/2062] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:55 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:55.359191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.360123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.360257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.360424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.360675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] PATH_INFO: `/v3/projects/41bce630ef814f9f921aaaf71b31c748` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.361889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41bce630ef814f9f921aaaf71b31c748)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.368710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.384149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cadcfd1-353a-4ba4-9f9b-bfba2f8e4356 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.389226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.390266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.390737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.391016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.391800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.393363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.404994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1028/2063] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:55.409198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.422042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6852c0-3698-419f-98f8-fc49fd86661e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.436465 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41bce630ef814f9f921aaaf71b31c748', 'request_id': 'req-291ac95d-06bf-4f82-b557-8ce5308013b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:55.443375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41bce630ef814f9f921aaaf71b31c748', 'request_id': 'req-291ac95d-06bf-4f82-b557-8ce5308013b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:55.452068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41bce630ef814f9f921aaaf71b31c748', 'request_id': 'req-291ac95d-06bf-4f82-b557-8ce5308013b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:55.463427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] The token cache is being invalidate because project 41bce630ef814f9f921aaaf71b31c748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:55.463743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:55.464414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-291ac95d-06bf-4f82-b557-8ce5308013b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:55.466029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1036/2064] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:55 2022] DELETE /identity/v3/projects/41bce630ef814f9f921aaaf71b31c748 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:55.471880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573bbeb-4091-4efe-b427-d6968ba6d840 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.472283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573bbeb-4091-4efe-b427-d6968ba6d840 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.472567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573bbeb-4091-4efe-b427-d6968ba6d840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.489690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.490699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.490984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.491248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d573bbeb-4091-4efe-b427-d6968ba6d840 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:55.491356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] PATH_INFO: `/v3/projects/9c9b420ebb654a0ab08c3c9087974f09/users/70cd84b90f844ba5a91f116bbac217dc/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.492459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d573bbeb-4091-4efe-b427-d6968ba6d840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:55.500507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1037/2065] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:55.508053 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9b420ebb654a0ab08c3c9087974f09, user_id=70cd84b90f844ba5a91f116bbac217dc, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.508974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.509268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.509549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.510738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.521931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:55.527561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1029/2066] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:55 2022] PUT /identity/v3/projects/9c9b420ebb654a0ab08c3c9087974f09/users/70cd84b90f844ba5a91f116bbac217dc/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:55.528807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:55.530012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:55.531565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.533834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:55.534772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:55.601277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1038/2067] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:58:55.602705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb853cd3-296e-41de-aeab-ee4d738f6037 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.602826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.608557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.609248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.609567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.609810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.610545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.612470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.615699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc571-e0dc-4104-98d5-4727212e1770 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.623232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.624218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.624732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.625137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.625998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:58:55.626499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.628446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.633410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1030/2068] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:55.637515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.648837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1039/2069] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:58:55.649859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3cec9-c4ee-4dd0-9fb4-f436a3d2dfa4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.650112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.654733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.655567 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.655847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.656116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] PATH_INFO: `/v3/projects/9c9b420ebb654a0ab08c3c9087974f09/users/70cd84b90f844ba5a91f116bbac217dc/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.660429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c9b420ebb654a0ab08c3c9087974f09, user_id=70cd84b90f844ba5a91f116bbac217dc, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.663202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.664921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a55cd4-36d4-487e-8677-e55823d1f235 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.672209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.673334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.673664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.674130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.674925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.676832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.680855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1031/2070] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:55 2022] PUT /identity/v3/projects/9c9b420ebb654a0ab08c3c9087974f09/users/70cd84b90f844ba5a91f116bbac217dc/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:55.712471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1040/2071] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:55 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:55.716539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.797172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c8c610-56a9-4429-b4b8-a7311430f3b2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.866788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.867702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.867988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.868267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.869133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.871302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.899458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1032/2072] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:55 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:55.903538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.918042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834b7ea-59ec-4f3e-b596-409c98234ae3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.924464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.925175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.925453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.925723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.926538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.928414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:55.942619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1041/2073] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:55.944060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:55.974777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67289fa-b63d-4be1-a9de-f4502598f40f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:55.980309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef01452-e26e-43b6-aedb-5c85a6bf8ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:55.981000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01452-e26e-43b6-aedb-5c85a6bf8ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:55.981283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01452-e26e-43b6-aedb-5c85a6bf8ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:55.981561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef01452-e26e-43b6-aedb-5c85a6bf8ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:55.982339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef01452-e26e-43b6-aedb-5c85a6bf8ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:55.983929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef01452-e26e-43b6-aedb-5c85a6bf8ad3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:56.001246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1033/2074] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:58:56.002898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:56.023767 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a72f0-d755-4b1c-a220-9d63478abf7e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:56.029521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:56.031017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:56.031303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:56.031580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] PATH_INFO: `/v3/projects/302b6c0263944e408c5d125d83b52958/users/2d33800efd4e4051b173355ed7337b89/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:56.055440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=302b6c0263944e408c5d125d83b52958, user_id=2d33800efd4e4051b173355ed7337b89, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:56.058215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:56.076722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1042/2075] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:56 2022] PUT /identity/v3/projects/302b6c0263944e408c5d125d83b52958/users/2d33800efd4e4051b173355ed7337b89/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:58:56.081580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd647e6-6f86-4f9a-8708-3d29b9510f3c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:56.081877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd647e6-6f86-4f9a-8708-3d29b9510f3c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:56.082159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd647e6-6f86-4f9a-8708-3d29b9510f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:56.101978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8cd647e6-6f86-4f9a-8708-3d29b9510f3c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:56.103129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8cd647e6-6f86-4f9a-8708-3d29b9510f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:56.108381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:56.203898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1034/2076] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:56.215462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:56.217708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:56.300755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ef20bb-7cdf-4d5a-ac88-0540c056d50b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:56.303950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:56.304755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:56.305042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:56.305319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:56.318170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:56.319463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:56.332766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1043/2077] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:57.351587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:57.352157 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:57.352157 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:57.388679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] MFA Rules not processed for user `2d33800efd4e4051b173355ed7337b89`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:57.390403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:57.498131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1035/2078] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:57.504502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:57.520091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6dbd-19dd-441d-9280-2c936aa8fbd1 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:57.530534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:57.532293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:57.537969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:57.540530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:57.541926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:57.542544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:57.546049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:57.549291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d281d960-5472-4bf9-859d-6bf546e9150c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:57.551626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:57.554327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:57.555401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:57.555683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:57.555959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] PATH_INFO: `/v3/users/776df7f120e1411ba9aaa5ccd96ea4ed` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:57.557180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=776df7f120e1411ba9aaa5ccd96ea4ed)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:57.559314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:57.615586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1044/2079] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:58:57 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:58:57.621139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:57.631214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776df7f120e1411ba9aaa5ccd96ea4ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:57.654345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776df7f120e1411ba9aaa5ccd96ea4ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:57.672949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776df7f120e1411ba9aaa5ccd96ea4ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:57.673984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776df7f120e1411ba9aaa5ccd96ea4ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:57.691639 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-2e797717-86f6-4cac-82ee-9a35834958fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776df7f120e1411ba9aaa5ccd96ea4ed'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:57.693263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:57.710790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1036/2080] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:57 2022] DELETE /identity/v3/users/776df7f120e1411ba9aaa5ccd96ea4ed => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:57.719330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:57.720165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:57.720336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:57.768528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:58:57.770072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:57.780778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:57.820276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df4dcb-54d3-40a3-b9e1-adcde886309e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:57.873923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1037/2081] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:58:57.886698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:57.888863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:57.918204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:57.919664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:57.920047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:57.920419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:57.921236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:57.930914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:57.988109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253df3a-c2d8-4b75-94f4-bf8b9ca08a1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:57.992853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:57.993816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:57.994178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:57.994826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:58.002583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1045/2082] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:58:57 2022] POST /identity/v3/users => generated 292 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:58:58.003876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:58.009226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:58.012178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:58.014606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:58.034215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1038/2083] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:58:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:58:58.041567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7204d3-1fe1-49a6-b82c-3c14c2cd63bb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:58.052156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:58.053622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:58.054053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:58.054457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:58.056063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:58.058058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:58.089587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1046/2084] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:58.093807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:58.108630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9ffa4-e0fb-4745-b70f-20b3d73fbcf1 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:58.119988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:58.120938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:58.121222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:58.121499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] PATH_INFO: `/v3/projects/c0ff60411ba048b4a49d6d6319b87f0b/users/2e5a8c772ecb4d5b82d9efefd1d45e7c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:58.146026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ff60411ba048b4a49d6d6319b87f0b, user_id=2e5a8c772ecb4d5b82d9efefd1d45e7c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:58.149611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:58.173954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1039/2085] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:58 2022] PUT /identity/v3/projects/c0ff60411ba048b4a49d6d6319b87f0b/users/2e5a8c772ecb4d5b82d9efefd1d45e7c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:58.175898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:58.192545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f56a08-41a3-4be8-96d0-2c3d8aabf9d0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:58.318569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:58.319540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:58.320541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:58.320907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:58.322033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:58.324459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:58.338556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1047/2086] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:58:58.342118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:58.360059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d400dc-3806-4aef-a364-5bcd47394065 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:58.378633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:58.379538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:58.379991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:58.380267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] PATH_INFO: `/v3/projects/c0ff60411ba048b4a49d6d6319b87f0b/users/2e5a8c772ecb4d5b82d9efefd1d45e7c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:58.382383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ff60411ba048b4a49d6d6319b87f0b, user_id=2e5a8c772ecb4d5b82d9efefd1d45e7c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:58.385928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:58.402456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1040/2087] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:58:58 2022] PUT /identity/v3/projects/c0ff60411ba048b4a49d6d6319b87f0b/users/2e5a8c772ecb4d5b82d9efefd1d45e7c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:58.605235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:58.607042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:58.632250 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ae943-3b23-46a0-993c-d37d37c674ab admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:58.733659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:58.774883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:58.775949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:58.776271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:58.776607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] PATH_INFO: `/v3/projects/7d8d1a19f2fd45738e37879f42db9e36` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:58.777850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d8d1a19f2fd45738e37879f42db9e36)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:58.779881 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:58.885568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d8d1a19f2fd45738e37879f42db9e36', 'request_id': 'req-6a0c8a66-4a09-4765-9c5e-2c49499bc213'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:58.907736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d8d1a19f2fd45738e37879f42db9e36', 'request_id': 'req-6a0c8a66-4a09-4765-9c5e-2c49499bc213'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:58.932805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d8d1a19f2fd45738e37879f42db9e36', 'request_id': 'req-6a0c8a66-4a09-4765-9c5e-2c49499bc213'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:58.962978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] The token cache is being invalidate because project 7d8d1a19f2fd45738e37879f42db9e36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:58:58.963650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:58.964916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6a0c8a66-4a09-4765-9c5e-2c49499bc213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:58.967327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1048/2088] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:58:58 2022] DELETE /identity/v3/projects/7d8d1a19f2fd45738e37879f42db9e36 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:58:58.971387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:58:58.974780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:58:59.005764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d8c7e-495c-4a0c-b509-ac05aa61dc64 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:58:59.210841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:58:59.211913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:58:59.212205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:58:59.212542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] PATH_INFO: `/v3/users/ca162a5b295448d086e163d41827bf24` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:58:59.218071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca162a5b295448d086e163d41827bf24)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:58:59.220211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:58:59.294783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:58:59.366971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca162a5b295448d086e163d41827bf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:59.401650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca162a5b295448d086e163d41827bf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:59.420019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca162a5b295448d086e163d41827bf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:59.420905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca162a5b295448d086e163d41827bf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:59.444087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca162a5b295448d086e163d41827bf24'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:58:59.463951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1041/2089] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:58:58 2022] DELETE /identity/v3/users/ca162a5b295448d086e163d41827bf24 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:00.133266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:00.134110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:00.134656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:00.175846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] MFA Rules not processed for user `2e5a8c772ecb4d5b82d9efefd1d45e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:00.177551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:00.347126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1049/2090] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:00.370076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:00.372728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:00.556777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a276f2-00ce-4eae-b088-aab839bba50d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:00.572689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:00.576108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:00.576779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:00.578020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:00.587844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:00.727650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:00.730062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:00.773664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1042/2091] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:59:00.801729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:00.803694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:00.943537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:00.945326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56077dc-4c3d-408b-8c89-808813c90a17 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:00.956928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:00.957816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:00.958203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:00.958510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] PATH_INFO: `/v3/projects/818a75d094cd4bc9aa4f8b53b320f120` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:00.967430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=818a75d094cd4bc9aa4f8b53b320f120)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:00.969626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:01.125189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818a75d094cd4bc9aa4f8b53b320f120', 'request_id': 'req-d39e3122-38e4-404b-9f87-d943811c8c9e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.134812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818a75d094cd4bc9aa4f8b53b320f120', 'request_id': 'req-d39e3122-38e4-404b-9f87-d943811c8c9e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.150128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818a75d094cd4bc9aa4f8b53b320f120', 'request_id': 'req-d39e3122-38e4-404b-9f87-d943811c8c9e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.176441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] The token cache is being invalidate because project 818a75d094cd4bc9aa4f8b53b320f120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:01.176994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.177899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.180143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1050/2092] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:00 2022] DELETE /identity/v3/projects/818a75d094cd4bc9aa4f8b53b320f120 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:01.183979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:01.203594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872dffc0-9f88-475a-94ad-da477e21ca3d service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:01.284752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:01.314530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:01.315682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:01.316164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:01.316630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] PATH_INFO: `/v3/users/1155ebe55f5e45b78d95fbe18fa5fad2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:01.318156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1155ebe55f5e45b78d95fbe18fa5fad2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:01.321561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:01.417173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1155ebe55f5e45b78d95fbe18fa5fad2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.450221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1155ebe55f5e45b78d95fbe18fa5fad2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.465658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1155ebe55f5e45b78d95fbe18fa5fad2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.466678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1155ebe55f5e45b78d95fbe18fa5fad2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.485650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1e01cd4a-b774-4e6a-a84c-6ec5dbc981a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1155ebe55f5e45b78d95fbe18fa5fad2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:01.502776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1043/2093] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:01 2022] DELETE /identity/v3/users/1155ebe55f5e45b78d95fbe18fa5fad2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:01.976033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:01.978359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:02.004810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e3122-38e4-404b-9f87-d943811c8c9e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.090351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.091423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.091711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.091990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] PATH_INFO: `/v3/projects/9af27034f6234fc9b9c34bace4220ac8` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.093208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af27034f6234fc9b9c34bace4220ac8)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.095187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.220586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af27034f6234fc9b9c34bace4220ac8', 'request_id': 'req-a7de2533-0bb5-408f-b652-8f645b00fb85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:02.233432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af27034f6234fc9b9c34bace4220ac8', 'request_id': 'req-a7de2533-0bb5-408f-b652-8f645b00fb85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:02.254322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af27034f6234fc9b9c34bace4220ac8', 'request_id': 'req-a7de2533-0bb5-408f-b652-8f645b00fb85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:02.284196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] The token cache is being invalidate because project 9af27034f6234fc9b9c34bace4220ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:02.284909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:02.285430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a7de2533-0bb5-408f-b652-8f645b00fb85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:02.288385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1051/2094] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:01 2022] DELETE /identity/v3/projects/9af27034f6234fc9b9c34bace4220ac8 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:02.294765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.295743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.296201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.339904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:02.340986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:02.483329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1044/2095] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:02.486075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.486075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.486363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.495012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.496738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:02.549142 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:02.550389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:02.573490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1052/2096] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:02.577733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.596546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3cd92-8031-4b79-80e4-9c8d941a5a97 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.602450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.603149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.603258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18694e9c-5310-439e-8d3f-17a0983ce93a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.603436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.603715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.606650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:02.607370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.609509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.609678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.610298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.610689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.611040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.612969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:02.619154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:02.632409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1053/2097] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:59:02.635365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.651121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91513f-fc7c-45eb-86af-f1333dcb0f92 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.659734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.660405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.660695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.661315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.662537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.664484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.669832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:02.723716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1054/2098] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:02 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:02.725541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.742787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.744602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.757944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1045/2099] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:59:02.812482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b125-348b-46af-9aeb-9bb7ca1bcbe0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.818914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.819462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.819749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.820027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.820733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.822710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.847893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1055/2100] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:02 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:59:02.851867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.865478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9a971-b81e-4127-8668-a42e48da0156 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.871160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.872212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.872501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.872776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.873670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.875631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.888394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1046/2101] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:59:02.898410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.914507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f54fdf-85dd-44e9-8d45-ce4929f97162 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.923980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03599d8-39a9-4d28-962e-d79b93e53eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.924703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03599d8-39a9-4d28-962e-d79b93e53eec admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.925459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03599d8-39a9-4d28-962e-d79b93e53eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.925744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03599d8-39a9-4d28-962e-d79b93e53eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:02.927674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03599d8-39a9-4d28-962e-d79b93e53eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:02.929282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03599d8-39a9-4d28-962e-d79b93e53eec admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:02.946262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1056/2102] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:02.947130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:02.968559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46378f7-0a1e-4513-a355-89f5f3c5c641 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:02.987665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:02.989530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:02.990818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:02.991319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] PATH_INFO: `/v3/projects/8c3c440830e643b79fc1681dd4a9e2a6/users/f7bd2a6714544db69a8260388b39a890/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:03.014708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3c440830e643b79fc1681dd4a9e2a6, user_id=f7bd2a6714544db69a8260388b39a890, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:03.018060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:03.037865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1047/2103] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:02 2022] PUT /identity/v3/projects/8c3c440830e643b79fc1681dd4a9e2a6/users/f7bd2a6714544db69a8260388b39a890/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:03.043708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e544-04f1-481e-b661-d4ee546bfea4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:03.044719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e544-04f1-481e-b661-d4ee546bfea4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:03.045006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e51e544-04f1-481e-b661-d4ee546bfea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:03.064229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1e51e544-04f1-481e-b661-d4ee546bfea4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:03.065461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1e51e544-04f1-481e-b661-d4ee546bfea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:03.152466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1057/2104] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:03.164738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:03.166909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:03.275849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6a0a9-c7c0-46d5-870a-830dcbc50ec5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:03.281960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:03.282805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:03.283608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:03.284011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:03.297575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:03.302922 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:03.322773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1048/2105] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:03.887847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddf737-da84-40a5-8bc7-fcb77e84750f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:03.888413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddf737-da84-40a5-8bc7-fcb77e84750f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:03.888509 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddf737-da84-40a5-8bc7-fcb77e84750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:03.941075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8dddf737-da84-40a5-8bc7-fcb77e84750f None None] MFA Rules not processed for user `70cd84b90f844ba5a91f116bbac217dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:03.942672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8dddf737-da84-40a5-8bc7-fcb77e84750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:04.037319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:04.086460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1058/2106] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:04.101630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:04.105607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:04.253092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6512fda0-af65-4824-8011-b68ee2722249 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:04.268394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:04.269178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:04.269481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:04.269814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:04.272914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:04.311700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:04.361044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:04.363430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:04.399372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1049/2107] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:06.844030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c03f4-f58d-4eb3-9223-7426470f3ccc None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:06.846302 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c03f4-f58d-4eb3-9223-7426470f3ccc None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:06.846836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c03f4-f58d-4eb3-9223-7426470f3ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:06.897603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2c7c03f4-f58d-4eb3-9223-7426470f3ccc None None] MFA Rules not processed for user `996f767ef6e843ffa49b893ddd832889`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:06.899232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2c7c03f4-f58d-4eb3-9223-7426470f3ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:06.919104 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1059/2108] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:07.702510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:07.703943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:07.734576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d16861-2b66-4f65-b563-be496dc69559 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:07.748950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:07.750815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:07.753813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:07.755285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] PATH_INFO: `/v3/users/167f9ef8952949e0b83a79c5003b9b2e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:07.758738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=167f9ef8952949e0b83a79c5003b9b2e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:07.767282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:07.891922 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '167f9ef8952949e0b83a79c5003b9b2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:07.925320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '167f9ef8952949e0b83a79c5003b9b2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:07.947167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '167f9ef8952949e0b83a79c5003b9b2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:07.947919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '167f9ef8952949e0b83a79c5003b9b2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:07.965210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '167f9ef8952949e0b83a79c5003b9b2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:07.975656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1050/2109] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:07 2022] DELETE /identity/v3/users/167f9ef8952949e0b83a79c5003b9b2e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:07.980260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:07.981293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:07.981719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:08.006916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:08.008482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:08.144676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1060/2110] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:08.156448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:08.157990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:08.264044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c20a-7ccd-403c-964e-271c580b5981 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:08.268812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:08.269641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:08.270057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:08.271024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:08.291010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:08.292699 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:08.307646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1051/2111] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:08.656999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:08.658612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:08.678713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8bacc-c2ba-463c-a0c0-d245f92fb5d8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:08.687885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:08.689407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:08.689857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:08.690267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] PATH_INFO: `/v3/projects/2a36ce66699f43ab9b8c4cb6d6d45feb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:08.691793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a36ce66699f43ab9b8c4cb6d6d45feb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:08.694207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:08.758204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a36ce66699f43ab9b8c4cb6d6d45feb', 'request_id': 'req-0c948f8a-20a2-4721-ae45-767386daa72d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:08.765907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a36ce66699f43ab9b8c4cb6d6d45feb', 'request_id': 'req-0c948f8a-20a2-4721-ae45-767386daa72d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:08.791290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a36ce66699f43ab9b8c4cb6d6d45feb', 'request_id': 'req-0c948f8a-20a2-4721-ae45-767386daa72d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:08.821946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] The token cache is being invalidate because project 2a36ce66699f43ab9b8c4cb6d6d45feb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:08.822721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:08.825272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-0c948f8a-20a2-4721-ae45-767386daa72d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:08.828317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1061/2112] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:08 2022] DELETE /identity/v3/projects/2a36ce66699f43ab9b8c4cb6d6d45feb => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:08.834557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:08.847610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b88c9-2ff4-4b45-b2e7-19520a33ffdd service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:08.915944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:08.927487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7fe63-4cbe-4f8f-bcb5-73754d667221 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:08.932308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7fe63-4cbe-4f8f-bcb5-73754d667221 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:08.932961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7fe63-4cbe-4f8f-bcb5-73754d667221 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:08.937420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1062/2113] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:59:08 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:59:08.959931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:08.960926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:08.961875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:08.962696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] PATH_INFO: `/v3/users/a59c4f009e83437793b23afed607abd0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:08.971176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59c4f009e83437793b23afed607abd0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:08.973338 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:08.981793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:08.985105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:08.985708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:09.039980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:09.042983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:09.098754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59c4f009e83437793b23afed607abd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.140693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59c4f009e83437793b23afed607abd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.156958 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59c4f009e83437793b23afed607abd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.157724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59c4f009e83437793b23afed607abd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.171782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59c4f009e83437793b23afed607abd0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.189909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1052/2114] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:08 2022] DELETE /identity/v3/users/a59c4f009e83437793b23afed607abd0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:09.190882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:09.192694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:09.246467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:09.282014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1063/2115] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:59:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:09.308848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:09.310594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:09.358241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb461fb-346a-4aa6-b4b1-343fa78cb0af None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:09.373287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d35ea-d9b0-47f6-b3a5-6488d36b4619 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:09.396867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:09.409311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:09.409754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:09.410034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] PATH_INFO: `/v3/users/055c4e8c15c44f9da390da49528ded1e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:09.418888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055c4e8c15c44f9da390da49528ded1e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:09.427297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:09.580872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055c4e8c15c44f9da390da49528ded1e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.613051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:09.613836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:09.614046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:09.614528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:09.618082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:09.638519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:09.640606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:09.646641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055c4e8c15c44f9da390da49528ded1e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.674285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055c4e8c15c44f9da390da49528ded1e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.675212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055c4e8c15c44f9da390da49528ded1e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.676070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1064/2116] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:09.703241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055c4e8c15c44f9da390da49528ded1e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:09.722348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1053/2117] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:09 2022] DELETE /identity/v3/users/055c4e8c15c44f9da390da49528ded1e => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:10.089962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:10.092217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:10.119014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79440e7a-603c-4946-9d52-7bfb0e3b5a2f service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:10.250198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:10.251384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.251770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.252178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] PATH_INFO: `/v3/projects/d5f19d886b144ac3a2db2dc642cc6bf0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.254357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f19d886b144ac3a2db2dc642cc6bf0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:10.259084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:10.294689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:10.297008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:10.345386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45da2fd-21ed-457e-aad8-3593d34f7e60 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:10.365553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f19d886b144ac3a2db2dc642cc6bf0', 'request_id': 'req-8eecd4e6-5d19-457c-ac33-d44333818e3b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.373991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f19d886b144ac3a2db2dc642cc6bf0', 'request_id': 'req-8eecd4e6-5d19-457c-ac33-d44333818e3b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.388188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f19d886b144ac3a2db2dc642cc6bf0', 'request_id': 'req-8eecd4e6-5d19-457c-ac33-d44333818e3b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.411816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] The token cache is being invalidate because project d5f19d886b144ac3a2db2dc642cc6bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:10.412776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.413860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8eecd4e6-5d19-457c-ac33-d44333818e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.415925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1065/2118] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:10 2022] DELETE /identity/v3/projects/d5f19d886b144ac3a2db2dc642cc6bf0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:10.421725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743cfe-216a-4932-8795-ffdf99ce00c4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.422160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743cfe-216a-4932-8795-ffdf99ce00c4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.422660 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743cfe-216a-4932-8795-ffdf99ce00c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.457246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ce743cfe-216a-4932-8795-ffdf99ce00c4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:10.459730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ce743cfe-216a-4932-8795-ffdf99ce00c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:10.466656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:10.467967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.468558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.469075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] PATH_INFO: `/v3/projects/ce2601d8ffd54c4aa0deaf0c2047b401` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.470649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce2601d8ffd54c4aa0deaf0c2047b401)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:10.472903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:10.493452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:10.560668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2601d8ffd54c4aa0deaf0c2047b401', 'request_id': 'req-c6f894ea-e04f-4403-a1f7-8b88862f7b62'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.584385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2601d8ffd54c4aa0deaf0c2047b401', 'request_id': 'req-c6f894ea-e04f-4403-a1f7-8b88862f7b62'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.604737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2601d8ffd54c4aa0deaf0c2047b401', 'request_id': 'req-c6f894ea-e04f-4403-a1f7-8b88862f7b62'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.637389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] The token cache is being invalidate because project ce2601d8ffd54c4aa0deaf0c2047b401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:10.638159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.640593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1066/2119] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:10.640856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c6f894ea-e04f-4403-a1f7-8b88862f7b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:10.646539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1054/2120] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:10 2022] DELETE /identity/v3/projects/ce2601d8ffd54c4aa0deaf0c2047b401 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:10.647551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d4a47-2d02-4f57-8753-a0ee3363be73 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.647843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d4a47-2d02-4f57-8753-a0ee3363be73 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.648113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d4a47-2d02-4f57-8753-a0ee3363be73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.651369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.651663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.653657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.690690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-172d4a47-2d02-4f57-8753-a0ee3363be73 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:10.697749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-172d4a47-2d02-4f57-8753-a0ee3363be73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:10.701377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:10.702348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:10.850692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1067/2121] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:10.863298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.863636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.864098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.868911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1055/2122] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:10.871183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:10.907433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:10.911596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:10.915494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e1678-7e12-43c6-a6d4-7aa379cc11fc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:10.927147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:10.928092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.929224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.929839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.931738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:10.932427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1068/2123] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:10.933354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:10.938231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:10.938750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:10.946273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:10.961264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8efd-a6b4-4384-aea6-f55e4f769b52 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:10.975643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:10.976399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:10.976745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:10.977038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:10.977885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:10.978203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:10.982450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:10.985295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1056/2124] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:59:10.986568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:10.998620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1822c5e2-3005-4806-bed7-af32f8244385 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.014443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.014443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.017995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.018459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.028374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.029803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1069/2125] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:59:11.030833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.038155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.049469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc614-857b-4907-965d-d453791293a0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.064643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.065415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.065733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.066018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.066783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.070071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.148055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1070/2126] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:11.153762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.162645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1057/2127] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:10 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:11.166634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.273201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d96d058-7d90-44a6-adc4-eb8c9380dad1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.285799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.286633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.287376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.287747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.288620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.291420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.307142 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da76b48-c6ea-47d2-9f27-2011a04d0f29 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.331389 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.332131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.332496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.332893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.333840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.334775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1058/2128] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:11.336065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.339215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.354037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479020d3-08e8-4b06-b3a0-b4f760805d19 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.361692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.362889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.363743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.364222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.365229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.367582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.376732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1071/2129] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/users => generated 296 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:11.380957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.386615 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1059/2130] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:59:11.391074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.391975 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:11.401282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5303-d104-4113-8b39-fc3a5874b611 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.406919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.408099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.408396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.408678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.409430 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.411620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.419322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9fa44d-f837-468e-b170-030aae1275e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.427145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1072/2131] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 09:59:11.428055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.433115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.434280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.434668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.435698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.436612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.438753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.439727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e2d39-c3a8-4b51-b2ed-a60168ac5944 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.445998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.446823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.447170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.447452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.448258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.450778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.459828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1060/2132] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:11.464898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.469166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1073/2133] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:11.473649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.477983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b0657-caed-4f26-86b0-f4ad5766afd7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.486076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db7b8b-b87f-4c01-a124-99024fecaac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.487062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7b8b-b87f-4c01-a124-99024fecaac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.487933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a7e89-3304-45f7-a832-6a203b5ad4d9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.488077 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7b8b-b87f-4c01-a124-99024fecaac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.488717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db7b8b-b87f-4c01-a124-99024fecaac3 admin admin] PATH_INFO: `/v3/projects/6da14c20cea64973aa0b6eca6659363a/users/f278853109724ed6856cebcb171eaaf9/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.498364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fad83e-0b3f-41d6-87cd-6f25864cdd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.499485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad83e-0b3f-41d6-87cd-6f25864cdd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.499838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad83e-0b3f-41d6-87cd-6f25864cdd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.500183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fad83e-0b3f-41d6-87cd-6f25864cdd5a admin admin] PATH_INFO: `/v3/projects/96563cd3d5ff4d149c0db484f1d5c51d/users/0dcfab314cf14d478e59c0b957193c72/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.511372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db7b8b-b87f-4c01-a124-99024fecaac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da14c20cea64973aa0b6eca6659363a, user_id=f278853109724ed6856cebcb171eaaf9, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.518521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db7b8b-b87f-4c01-a124-99024fecaac3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.521794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fad83e-0b3f-41d6-87cd-6f25864cdd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=96563cd3d5ff4d149c0db484f1d5c51d, user_id=0dcfab314cf14d478e59c0b957193c72, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.525816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fad83e-0b3f-41d6-87cd-6f25864cdd5a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.552531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1074/2135] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:11 2022] PUT /identity/v3/projects/96563cd3d5ff4d149c0db484f1d5c51d/users/0dcfab314cf14d478e59c0b957193c72/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:11.554608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f05d-8095-41bd-abd0-9c2f69c08e00 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.554973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f05d-8095-41bd-abd0-9c2f69c08e00 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.555517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5f05d-8095-41bd-abd0-9c2f69c08e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.560804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1061/2135] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:11 2022] PUT /identity/v3/projects/6da14c20cea64973aa0b6eca6659363a/users/f278853109724ed6856cebcb171eaaf9/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:11.562518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.563270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.563575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.593544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a0f5f05d-8095-41bd-abd0-9c2f69c08e00 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:11.595989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a0f5f05d-8095-41bd-abd0-9c2f69c08e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:11.605512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] MFA Rules not processed for user `f278853109724ed6856cebcb171eaaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:11.606802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:11.669244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1075/2136] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:11.670868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.671160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.671442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.701563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] MFA Rules not processed for user `f7bd2a6714544db69a8260388b39a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:11.702844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:11.711369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1062/2137] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:11.711369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.712382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:11.726717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:11.797969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537323ca-1e95-4cc4-91b9-955d8b5c0f51 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.803323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.804045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.804298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.804571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.806314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1076/2138] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:11.807369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.808737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:11.815441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.816885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.828341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1063/2139] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:11.839606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.841965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:11.860661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6213e9-8b3b-444b-b0a9-80c10937f217 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.866377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.867144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.867450 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.867724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.868443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.870347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.897458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:11.902177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c85ebf-b571-4808-b707-f9dbe40cb9ef None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:11.908885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:11.909685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:11.910105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:11.910603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:11.914748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1064/2140] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:11.916084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.928159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:11.929613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:11.941051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1077/2141] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:11.969088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:11.986214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946860a1-0020-4ab8-8ecd-cdff3a8b538d service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.015970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f504e7f-45f1-4d23-a85e-27914a8fb31b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.023515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.024337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.024904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.025316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.026760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.028836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.057641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1065/2142] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:11 2022] POST /identity/v3/users => generated 299 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:59:12.058968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:12.067495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.068200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.068612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.068888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] PATH_INFO: `/v3/users/f278853109724ed6856cebcb171eaaf9` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.070396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f212c939-1c77-46c2-870b-9d0aac19b4df admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.070549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f278853109724ed6856cebcb171eaaf9)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.072619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.075943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.076404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.076662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.077053 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.077990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.080098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.093659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1066/2143] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:12.097819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:12.113655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa1321-158e-4d24-adf4-c7952ee99317 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.121785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.122768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.123065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.123329 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] PATH_INFO: `/v3/projects/ef4c84f286d148c7a8bc412b8afdf8d4/users/beb8422305bf4b008056c38add4d4d93/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.141516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4c84f286d148c7a8bc412b8afdf8d4, user_id=beb8422305bf4b008056c38add4d4d93, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.142683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f278853109724ed6856cebcb171eaaf9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:12.144882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.157074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f278853109724ed6856cebcb171eaaf9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:12.160634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1067/2144] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:12 2022] PUT /identity/v3/projects/ef4c84f286d148c7a8bc412b8afdf8d4/users/beb8422305bf4b008056c38add4d4d93/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:12.164878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:12.173490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f278853109724ed6856cebcb171eaaf9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:12.184098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f278853109724ed6856cebcb171eaaf9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:12.185501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-78fd94f3-0639-4656-9ccd-ad15643f68f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f278853109724ed6856cebcb171eaaf9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:12.192585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1078/2145] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:11 2022] DELETE /identity/v3/users/f278853109724ed6856cebcb171eaaf9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:12.197287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.197692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.198062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.221420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:12.222948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:12.268459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:12.355850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf176e3-d9a7-479a-be98-22c66878ec5a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.382911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1079/2146] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:12.394566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:12.396696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:12.419834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:12.495390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.496087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.496379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.496815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.497656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.499353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.522731 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1068/2147] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:12.526024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80eb0d5-3a15-4097-a1f6-f5306b598683 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.527205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:12.529625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:12.551099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.551953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.552290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.552512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.570863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205047d-c7ca-4139-bcea-3c09a06a0582 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:12.573674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.575235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.582036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ecb51-19c0-4ea3-bba8-0d490b31386f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:12.585622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ecb51-19c0-4ea3-bba8-0d490b31386f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:12.585930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ecb51-19c0-4ea3-bba8-0d490b31386f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:12.586923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ecb51-19c0-4ea3-bba8-0d490b31386f admin admin] PATH_INFO: `/v3/projects/ef4c84f286d148c7a8bc412b8afdf8d4/users/beb8422305bf4b008056c38add4d4d93/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:12.588395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1080/2148] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:59:12.589290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ecb51-19c0-4ea3-bba8-0d490b31386f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4c84f286d148c7a8bc412b8afdf8d4, user_id=beb8422305bf4b008056c38add4d4d93, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:12.592186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ecb51-19c0-4ea3-bba8-0d490b31386f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:12.612779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1069/2149] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:12 2022] PUT /identity/v3/projects/ef4c84f286d148c7a8bc412b8afdf8d4/users/beb8422305bf4b008056c38add4d4d93/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:13.048993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:13.050757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:13.068143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f4fc4-8c53-4bb0-82e4-e08872b14ef3 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:13.235514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:13.237319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:13.238008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:13.238654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] PATH_INFO: `/v3/projects/6da14c20cea64973aa0b6eca6659363a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:13.240455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da14c20cea64973aa0b6eca6659363a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:13.243521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:13.370268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da14c20cea64973aa0b6eca6659363a', 'request_id': 'req-db874552-f69f-423d-89cc-e3de5502e678'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:13.380597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da14c20cea64973aa0b6eca6659363a', 'request_id': 'req-db874552-f69f-423d-89cc-e3de5502e678'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:13.412018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da14c20cea64973aa0b6eca6659363a', 'request_id': 'req-db874552-f69f-423d-89cc-e3de5502e678'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:13.430473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] The token cache is being invalidate because project 6da14c20cea64973aa0b6eca6659363a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:13.430914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:13.431740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-db874552-f69f-423d-89cc-e3de5502e678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:13.433448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1081/2150] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:13 2022] DELETE /identity/v3/projects/6da14c20cea64973aa0b6eca6659363a => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:13.438477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:13.439001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:13.439001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:13.470019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:13.473130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:13.648214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1070/2151] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:13.658017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:13.658265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:13.658494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:13.688981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:13.690347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:13.707740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1082/2152] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:13.708704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:13.723155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea4d27b-223d-451f-b0c0-6617442a892a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:13.731938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:13.732935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:13.735382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:13.735832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:13.737061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:13.737393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:13.749352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:13.781054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1071/2153] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:59:13.787038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:13.803602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c8be3c-5b1c-40be-a56c-42df59212e69 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:13.818861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:13.819607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:13.819898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:13.820182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:13.824469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:13.831642 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:13.888323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1083/2154] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:13 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:13.892491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:13.913641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308da775-2107-41e8-b1d3-3241ed04e799 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:14.085068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:14.085868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:14.086209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:14.086561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:14.093223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:14.096867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:14.111268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:14.143674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1072/2155] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:13 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:14.146159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:14.169195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7f2fd-bb42-4a1e-bfa5-38e1a0bc410f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:14.186133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:14.188789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:14.189101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:14.190132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:14.192853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:14.196617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:14.236263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1084/2156] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:14.240997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:14.257002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8841111e-223b-4934-a5d1-8e318720a17c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:14.267192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563e93-6c0f-4b63-a423-907658983d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:14.268021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563e93-6c0f-4b63-a423-907658983d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:14.268403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563e93-6c0f-4b63-a423-907658983d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:14.268812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563e93-6c0f-4b63-a423-907658983d70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:14.269651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563e93-6c0f-4b63-a423-907658983d70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:14.272758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563e93-6c0f-4b63-a423-907658983d70 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:14.301488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1073/2157] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:14.302021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:14.307364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:14.317957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8041e-ec91-4642-be73-e560a04eff36 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:14.343514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:14.344566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:14.344944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:14.345135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] PATH_INFO: `/v3/projects/2b1f78bde0434a8693dfb98d303a37a6/users/fac1f195080949378d34f085464b43bc/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:14.401343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b1f78bde0434a8693dfb98d303a37a6, user_id=fac1f195080949378d34f085464b43bc, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:14.404246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:14.439656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1085/2158] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:14 2022] PUT /identity/v3/projects/2b1f78bde0434a8693dfb98d303a37a6/users/fac1f195080949378d34f085464b43bc/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:14.452031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:14.452031 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:14.452771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:14.509466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] MFA Rules not processed for user `fac1f195080949378d34f085464b43bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:14.511016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:14.674838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1074/2159] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:14.686967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:14.689872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:14.840681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c646007-aa1a-4d22-9420-5fc8685d7a3d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:14.846913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f02c9-0d90-4e6d-b14e-d75857fb3979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:14.847684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f02c9-0d90-4e6d-b14e-d75857fb3979 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:14.848681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f02c9-0d90-4e6d-b14e-d75857fb3979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:14.848993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f02c9-0d90-4e6d-b14e-d75857fb3979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:14.881748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f02c9-0d90-4e6d-b14e-d75857fb3979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:14.883689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29f02c9-0d90-4e6d-b14e-d75857fb3979 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:14.902816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1086/2160] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:14.913487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:15.122300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90e506-ccce-47fe-b79d-8fee0a517fba None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:15.135369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:15.136302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:15.136589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:15.136865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] PATH_INFO: `/v3/users/fac1f195080949378d34f085464b43bc` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:15.139278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac1f195080949378d34f085464b43bc)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:15.142006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:15.229474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac1f195080949378d34f085464b43bc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:15.251652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac1f195080949378d34f085464b43bc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:15.256536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:15.262259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac1f195080949378d34f085464b43bc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:15.266131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac1f195080949378d34f085464b43bc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:15.282348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac1f195080949378d34f085464b43bc'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:15.296071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1075/2161] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:14 2022] DELETE /identity/v3/users/fac1f195080949378d34f085464b43bc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:15.300281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:15.300818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:15.300818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:15.347559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:15.367042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:15.474630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1087/2162] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:15.508462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:15.510375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:15.624238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167866a6-e824-43fc-8472-a26b45da25b9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:15.628225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46d263-2f9a-4cb9-8a0f-628229c1304d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:15.629116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d263-2f9a-4cb9-8a0f-628229c1304d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:15.629573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d263-2f9a-4cb9-8a0f-628229c1304d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:15.630010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46d263-2f9a-4cb9-8a0f-628229c1304d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:15.648554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d263-2f9a-4cb9-8a0f-628229c1304d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:15.650313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc46d263-2f9a-4cb9-8a0f-628229c1304d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:15.663493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1076/2163] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:16.667525 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:16.669681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:16.697994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc57f6-565d-45fe-933e-908f3249b9c1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:16.709797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:16.711020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:16.711477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:16.712197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] PATH_INFO: `/v3/projects/2b1f78bde0434a8693dfb98d303a37a6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:16.715774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b1f78bde0434a8693dfb98d303a37a6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:16.720054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:16.862198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1f78bde0434a8693dfb98d303a37a6', 'request_id': 'req-24a5383a-82fb-47d5-a6ba-99013109da10'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:16.870258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1f78bde0434a8693dfb98d303a37a6', 'request_id': 'req-24a5383a-82fb-47d5-a6ba-99013109da10'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:16.882606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1f78bde0434a8693dfb98d303a37a6', 'request_id': 'req-24a5383a-82fb-47d5-a6ba-99013109da10'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:16.902218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] The token cache is being invalidate because project 2b1f78bde0434a8693dfb98d303a37a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:16.903225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:16.904279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-24a5383a-82fb-47d5-a6ba-99013109da10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:16.906951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1088/2164] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:16 2022] DELETE /identity/v3/projects/2b1f78bde0434a8693dfb98d303a37a6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:16.918718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:16.922361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:16.922878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:16.959541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:16.961228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:17.077636 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1077/2165] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:17.087164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.087449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.087770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.099220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:17.131484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:17.132943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:17.157487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:17.162997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1089/2166] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:17.185525 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94991109-e623-4915-aa0b-57f8abe52c4e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:17.201357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:17.202046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.202320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.205046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.206007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:17.208418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:17.210564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:17.232436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:17.242283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1078/2167] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:59:17.251559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71b703-47b1-4869-b138-08df7d283240 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:17.264501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:17.265781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.268376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.268818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.269685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:17.272827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:17.325126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:17.334671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1090/2168] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:17 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:17.339043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdc43a-12a2-4cad-b911-69423353fe40 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:17.513351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:17.514677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.515306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.515585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.516299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:17.518572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:17.601134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1079/2169] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:17 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:17.604997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:17.617100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159a9f68-fec2-45fa-90ef-7a4a9d0610b7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:17.624721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:17.625797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.626308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.627461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.628446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:17.631906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:17.651271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:17.654062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1091/2170] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:17.676115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a589bb-aac2-4b8d-bc1c-aa8e0952d68f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:17.688291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65d869-f21d-4787-916f-916ee583b429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:17.689010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65d869-f21d-4787-916f-916ee583b429 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.689512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65d869-f21d-4787-916f-916ee583b429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.689640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65d869-f21d-4787-916f-916ee583b429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.690274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65d869-f21d-4787-916f-916ee583b429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:17.692008 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65d869-f21d-4787-916f-916ee583b429 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:17.693863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:17.720130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1080/2171] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:17.720800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:17.736781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4050af2-9b91-4afd-916d-93429b54e6f8 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:17.748788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:17.750381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.751639 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.752722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] PATH_INFO: `/v3/projects/d0298e827b7741c1b42f0698d5e6975a/users/a746a09ff3d545719f49e45a47dd5edb/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.832914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0298e827b7741c1b42f0698d5e6975a, user_id=a746a09ff3d545719f49e45a47dd5edb, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:17.843434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:17.896077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1092/2172] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:17 2022] PUT /identity/v3/projects/d0298e827b7741c1b42f0698d5e6975a/users/a746a09ff3d545719f49e45a47dd5edb/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:17.906774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80142883-c70e-488c-81fc-d078d9919454 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:17.907020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80142883-c70e-488c-81fc-d078d9919454 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:17.907297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80142883-c70e-488c-81fc-d078d9919454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:17.992620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-80142883-c70e-488c-81fc-d078d9919454 None None] MFA Rules not processed for user `a746a09ff3d545719f49e45a47dd5edb`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:17.993624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-80142883-c70e-488c-81fc-d078d9919454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:18.196490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1081/2173] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:18.206050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:18.208522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:18.360840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d60fa62-479c-41ca-bd85-41c946bb7326 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:18.371386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf29b9-7219-469d-a82a-3ca2537d05c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:18.372166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf29b9-7219-469d-a82a-3ca2537d05c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:18.372503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf29b9-7219-469d-a82a-3ca2537d05c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:18.372848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf29b9-7219-469d-a82a-3ca2537d05c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:18.391686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf29b9-7219-469d-a82a-3ca2537d05c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:18.393167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf29b9-7219-469d-a82a-3ca2537d05c7 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:18.422917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1093/2174] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:59:19.548220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b11826-d179-4d0a-bf2c-b725fb1ec69a None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:19.548681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b11826-d179-4d0a-bf2c-b725fb1ec69a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:19.548779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b11826-d179-4d0a-bf2c-b725fb1ec69a None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:19.550234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1082/2175] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 09:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 09:59:19.623756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56030e-084c-4486-a78d-1481c64a6d6f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:19.624298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56030e-084c-4486-a78d-1481c64a6d6f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:19.624401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56030e-084c-4486-a78d-1481c64a6d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:19.682386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2e56030e-084c-4486-a78d-1481c64a6d6f None None] MFA Rules not processed for user `b89a3526406c42819414b773fe8663ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:19.683643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2e56030e-084c-4486-a78d-1481c64a6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:19.870111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1094/2176] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 09:59:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:19.916059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b11826-d179-4d0a-bf2c-b725fb1ec69a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:19.918280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-46b11826-d179-4d0a-bf2c-b725fb1ec69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:19.955121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b11826-d179-4d0a-bf2c-b725fb1ec69a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:19.968082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:19.969071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:19.969575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:19.969989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:19.986085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:19.989283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:20.003881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1083/2177] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:21.353007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:21.353789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:21.354216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:21.435376 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] MFA Rules not processed for user `beb8422305bf4b008056c38add4d4d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:21.436640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:21.490924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:21.492344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:21.544807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:21.701403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428badf-8636-4527-931c-d43b79f11ce0 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:21.713531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:21.716346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:21.716872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:21.717311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] PATH_INFO: `/v3/users/2d33800efd4e4051b173355ed7337b89` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:21.720497 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d33800efd4e4051b173355ed7337b89)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:21.728867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:21.730022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1095/2178] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:21.731261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:21.736890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:21.836854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d33800efd4e4051b173355ed7337b89'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:21.867101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d33800efd4e4051b173355ed7337b89'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:21.888477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d33800efd4e4051b173355ed7337b89'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:21.889206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d33800efd4e4051b173355ed7337b89'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:21.893983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:21.898996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f5cec664-ff31-460b-9340-33839f083864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d33800efd4e4051b173355ed7337b89'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:21.901743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44c638-549b-48b2-bdeb-7605a87b222b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:21.906885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:21.907758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:21.908153 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:21.908537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:21.910724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1084/2179] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:21 2022] DELETE /identity/v3/users/2d33800efd4e4051b173355ed7337b89 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:21.912096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67da18-9a5c-471a-8e96-d183698b8c48 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:21.912387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67da18-9a5c-471a-8e96-d183698b8c48 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:21.912665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67da18-9a5c-471a-8e96-d183698b8c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:21.914508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:21.990857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8d67da18-9a5c-471a-8e96-d183698b8c48 None None] MFA Rules not processed for user `0dcfab314cf14d478e59c0b957193c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:21.994341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d67da18-9a5c-471a-8e96-d183698b8c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.012948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:22.015650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbbd4a3-7a1b-45de-aa43-fb23fc2328e2 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:22.033007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1096/2180] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:22.143387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1085/2181] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:22.156600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:22.157069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:22.157360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:22.195403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] MFA Rules not processed for user `0dcfab314cf14d478e59c0b957193c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:22.197327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.204784 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:22.205086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:22.205351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:22.209772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1097/2182] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:22.223953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:22.227593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.251518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:22.253887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.362452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1086/2183] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:59:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:22.372908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:22.396773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:22.405021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.418028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206925b-1e39-4f53-b2b2-fe46595bde86 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:22.426503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:22.427038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:22.427573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:22.427990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:22.439659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:22.441541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:22.460168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1098/2184] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:22.468958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:22.471106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.547987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ddb633-7e19-4117-abe8-b864b937c585 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:22.565402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:22.566710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:22.567236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:22.567695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] PATH_INFO: `/v3/projects/302b6c0263944e408c5d125d83b52958` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:22.569438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302b6c0263944e408c5d125d83b52958)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:22.572251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:22.618735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:22.637626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eba5f0-0461-4e3e-835b-7e5566cdce6c service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:22.648348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302b6c0263944e408c5d125d83b52958', 'request_id': 'req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.666551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302b6c0263944e408c5d125d83b52958', 'request_id': 'req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.680304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302b6c0263944e408c5d125d83b52958', 'request_id': 'req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.708576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] The token cache is being invalidate because project 302b6c0263944e408c5d125d83b52958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:22.710033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.712144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.715260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1087/2185] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:22 2022] DELETE /identity/v3/projects/302b6c0263944e408c5d125d83b52958 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:22.719814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:22.722661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.810850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:22.811584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:22.812086 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:22.812237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:22.816209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:22.845123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac26fe-3e4e-4cd7-9ede-cbad85556c38 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:22.853589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63606126-4254-44af-9abd-efc765356498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:22.855190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606126-4254-44af-9abd-efc765356498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:22.855559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606126-4254-44af-9abd-efc765356498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:22.855912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63606126-4254-44af-9abd-efc765356498 admin admin] PATH_INFO: `/v3/users/2e5a8c772ecb4d5b82d9efefd1d45e7c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:22.857689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63606126-4254-44af-9abd-efc765356498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5a8c772ecb4d5b82d9efefd1d45e7c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:22.860240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63606126-4254-44af-9abd-efc765356498 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:22.930665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63606126-4254-44af-9abd-efc765356498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5a8c772ecb4d5b82d9efefd1d45e7c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.949204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:22.953311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:22.958205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63606126-4254-44af-9abd-efc765356498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5a8c772ecb4d5b82d9efefd1d45e7c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.969654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1099/2186] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 09:59:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:59:22.971897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63606126-4254-44af-9abd-efc765356498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5a8c772ecb4d5b82d9efefd1d45e7c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.972591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63606126-4254-44af-9abd-efc765356498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5a8c772ecb4d5b82d9efefd1d45e7c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:22.983308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-63606126-4254-44af-9abd-efc765356498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5a8c772ecb4d5b82d9efefd1d45e7c'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:23.002924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1088/2187] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:22 2022] DELETE /identity/v3/users/2e5a8c772ecb4d5b82d9efefd1d45e7c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:23.326888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:23.345681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e26e2a-e3bb-4f9b-a8de-ef4265def310 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:23.384316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:23.482991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:23.484273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:23.485019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:23.485918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] PATH_INFO: `/v3/projects/c0ff60411ba048b4a49d6d6319b87f0b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:23.488943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ff60411ba048b4a49d6d6319b87f0b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:23.491185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:23.516299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936fdaa-0297-4657-9b5f-a24badebac3e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:23.516987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936fdaa-0297-4657-9b5f-a24badebac3e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:23.517580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2936fdaa-0297-4657-9b5f-a24badebac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:23.542405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-2936fdaa-0297-4657-9b5f-a24badebac3e None None] MFA Rules not processed for user `0dcfab314cf14d478e59c0b957193c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:23.544768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2936fdaa-0297-4657-9b5f-a24badebac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:23.593259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ff60411ba048b4a49d6d6319b87f0b', 'request_id': 'req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:23.602304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:23.602857 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ff60411ba048b4a49d6d6319b87f0b', 'request_id': 'req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:23.636424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ff60411ba048b4a49d6d6319b87f0b', 'request_id': 'req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:23.667006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1089/2188] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:23.668962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] The token cache is being invalidate because project c0ff60411ba048b4a49d6d6319b87f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:23.669255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:23.669907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ba37dd2c-dfc5-4b57-a168-07f9c1b82ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:23.679916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1100/2189] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:23 2022] DELETE /identity/v3/projects/c0ff60411ba048b4a49d6d6319b87f0b => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:23.686939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:23.687233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:23.687518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:23.719419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:23.738111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:23.870122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1090/2190] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:23.878280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:23.878684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:23.879065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:23.926914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:23.928782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:23.947977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1101/2191] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:23.949070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:23.973936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5190a4e-086d-48e2-bad4-d83b52a8e3bc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:23.989460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:23.990340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:23.990657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:23.991109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:23.991862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:23.992156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:23.993770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:24.038540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1091/2192] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 09:59:24.040396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:24.056965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d2ad13-2900-43ad-bcb6-7065ee05bcc2 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:24.097386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:24.102706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:24.103040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:24.103412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:24.108755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:24.117732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:24.196630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1102/2193] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:24 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:24.198395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:24.216458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafdc57c-3ad9-4ff8-8daf-9574298dede2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:24.319163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:24.320339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:24.320629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:24.321385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:24.322818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:24.325744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:24.361900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1092/2194] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:24 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 09:59:24.377439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:24.392489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f2d5d-5b00-4a11-88b5-59e91134521e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:24.401414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:24.402106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:24.402361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:24.402721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:24.403481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:24.405267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:24.444911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1103/2195] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:24.449129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:24.465621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afa750-e50f-41f9-a094-46ca7c2560f1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:24.479825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e165c-67f0-44dc-ad19-ac085ab57fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:24.480517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e165c-67f0-44dc-ad19-ac085ab57fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:24.481181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e165c-67f0-44dc-ad19-ac085ab57fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:24.481513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e165c-67f0-44dc-ad19-ac085ab57fe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:24.482712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e165c-67f0-44dc-ad19-ac085ab57fe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:24.484757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e165c-67f0-44dc-ad19-ac085ab57fe2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:24.506656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1093/2196] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:24.513644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:24.538046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67127142-a75e-477c-9d8e-aced296c7463 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:24.561522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:24.564233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:24.564969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:24.565403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] PATH_INFO: `/v3/projects/73c5b860ab454ad19f1a1217045aa988/users/364d2064ce3a4a3aae9643ec962e5395/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:24.613359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c5b860ab454ad19f1a1217045aa988, user_id=364d2064ce3a4a3aae9643ec962e5395, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:24.616851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:24.684442 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1104/2197] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:24 2022] PUT /identity/v3/projects/73c5b860ab454ad19f1a1217045aa988/users/364d2064ce3a4a3aae9643ec962e5395/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:24.692939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:24.693438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:24.693530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:24.732310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:24.734209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:24.909186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:24.968685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1094/2198] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:24.996750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:24.998789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:25.174031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:25.189542 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6fd5f-6706-4f1d-a7ad-d51852fc8c3e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:25.215193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44075a01-4b3c-4555-8c57-c9754900b312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:25.217773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075a01-4b3c-4555-8c57-c9754900b312 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:25.218242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075a01-4b3c-4555-8c57-c9754900b312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:25.228949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44075a01-4b3c-4555-8c57-c9754900b312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:25.259667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44075a01-4b3c-4555-8c57-c9754900b312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:25.261428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44075a01-4b3c-4555-8c57-c9754900b312 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:25.276843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1105/2199] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 09:59:28.878687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:28.880389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:28.911596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31560fef-2c9f-434e-9687-6354e2c434d6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:28.946474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:28.952704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:28.953021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:28.953305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] PATH_INFO: `/v3/users/a746a09ff3d545719f49e45a47dd5edb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:28.965322 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a746a09ff3d545719f49e45a47dd5edb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:28.976900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:29.113872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a746a09ff3d545719f49e45a47dd5edb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:29.147641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a746a09ff3d545719f49e45a47dd5edb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:29.165711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a746a09ff3d545719f49e45a47dd5edb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:29.166305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a746a09ff3d545719f49e45a47dd5edb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:29.181979 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a746a09ff3d545719f49e45a47dd5edb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:29.194904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1095/2200] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 09:59:28 2022] DELETE /identity/v3/users/a746a09ff3d545719f49e45a47dd5edb => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:29.196501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:29.198000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:29.198545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:29.234816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:29.238746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:29.385748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1106/2201] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:29.401571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:29.403301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:29.549826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b9db9-67cf-4672-adbd-b26a3d1e4391 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:29.568571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef339-fa89-4d5a-a036-8fdbb4faa79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:29.569365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef339-fa89-4d5a-a036-8fdbb4faa79f service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:29.569530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef339-fa89-4d5a-a036-8fdbb4faa79f service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:29.569804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef339-fa89-4d5a-a036-8fdbb4faa79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:29.600778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef339-fa89-4d5a-a036-8fdbb4faa79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:29.602241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef339-fa89-4d5a-a036-8fdbb4faa79f service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:29.623005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1096/2202] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:33.393792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:33.396565 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:33.438937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f5c78-5131-4ef8-987b-4b271963f52a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:33.450446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:33.451562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:33.451950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:33.452327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] PATH_INFO: `/v3/projects/d0298e827b7741c1b42f0698d5e6975a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:33.455039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0298e827b7741c1b42f0698d5e6975a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:33.460464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:33.635422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0298e827b7741c1b42f0698d5e6975a', 'request_id': 'req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:33.651200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0298e827b7741c1b42f0698d5e6975a', 'request_id': 'req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:33.667187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0298e827b7741c1b42f0698d5e6975a', 'request_id': 'req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:33.695458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] The token cache is being invalidate because project d0298e827b7741c1b42f0698d5e6975a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 09:59:33.695723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:33.696393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-4f43b354-aa0c-4c0d-bd1d-7d79fc6b3b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 09:59:33.702138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1107/2203] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 09:59:33 2022] DELETE /identity/v3/projects/d0298e827b7741c1b42f0698d5e6975a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:33.707577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:33.708771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:33.709260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:33.779288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:33.795471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:34.050490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1097/2204] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:34.060506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.060789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.061064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.121141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:34.130062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:34.152372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1108/2205] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:34.156542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:34.164500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:34.168796 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcdf75-c949-451a-b2d5-88d9db499d42 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:34.181333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:34.182213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.182341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.182637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.184011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 09:59:34.185595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:34.187320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:34.242655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1098/2206] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 09:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 09:59:34.243074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:34.265364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244afbd-0479-4751-97b3-142b128024f1 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:34.278332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:34.279043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.279324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.279596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.280313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:34.282251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:34.427539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1109/2207] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:34 2022] POST /identity/v3/projects => generated 363 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:34.429592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:34.444505 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219e105e-d2f7-4690-9a49-3bdaf6ad908a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:34.616529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:34.617651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.617945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.618232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.618972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:34.623134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:34.665990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1099/2208] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:34 2022] POST /identity/v3/users => generated 282 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:34.669922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:34.693750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810ac45-0c8e-4032-82e5-e2317abd3107 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:34.708050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:34.709023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.709460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.709906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.710856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:34.712887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:34.745236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1110/2209] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:34.749511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:34.769691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7c0e5-ebe2-4cf3-94d3-044ed3245ecb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:34.780982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09923b51-9489-4563-ac17-6f3ea7735751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:34.781963 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923b51-9489-4563-ac17-6f3ea7735751 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.782453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923b51-9489-4563-ac17-6f3ea7735751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.782880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09923b51-9489-4563-ac17-6f3ea7735751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.783794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923b51-9489-4563-ac17-6f3ea7735751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:34.785763 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09923b51-9489-4563-ac17-6f3ea7735751 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:34.828418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1100/2210] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:34.830038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:34.851776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f9812f-c5b5-40f6-bf7a-240a722fce9d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:34.873763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:34.874982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.875410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.875856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] PATH_INFO: `/v3/projects/3a1df4705f1d4626857e4b99336fe2b3/users/abd663ccaea74a1e989548a4f97175c2/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:34.937508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a1df4705f1d4626857e4b99336fe2b3, user_id=abd663ccaea74a1e989548a4f97175c2, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:34.940228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:34.968161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1111/2211] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:34 2022] PUT /identity/v3/projects/3a1df4705f1d4626857e4b99336fe2b3/users/abd663ccaea74a1e989548a4f97175c2/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:34.980743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546dc11-a9b2-4b0b-b4b8-a211f805ef5a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:34.980743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546dc11-a9b2-4b0b-b4b8-a211f805ef5a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:34.981101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3546dc11-a9b2-4b0b-b4b8-a211f805ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:35.039304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3546dc11-a9b2-4b0b-b4b8-a211f805ef5a None None] MFA Rules not processed for user `abd663ccaea74a1e989548a4f97175c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:35.040540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3546dc11-a9b2-4b0b-b4b8-a211f805ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:35.198511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1101/2212] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:34 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:35.206369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:35.208919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:35.235255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:35.402800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6730ec-c6aa-41ae-941a-971705bf29ba admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:35.413194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:35.414570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:35.414969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:35.415348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:35.434216 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:35.438765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:35.477963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1112/2213] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 09:59:39.866349 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:39.867060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:39.867444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:39.934242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] MFA Rules not processed for user `364d2064ce3a4a3aae9643ec962e5395`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:39.937238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:40.070229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:40.122657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1102/2214] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:40.123939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:40.125493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:40.301570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947f534-f870-47a5-9964-c76040a5beb0 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:40.308404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:40.308404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:40.309426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:40.309720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:40.310569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:40.314270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:40.381716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1113/2215] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 09:59:40 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:40.386246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:40.425406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e206a4c1-2053-47ea-8634-a4188f102991 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:40.573577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:40.574458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:40.574817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:40.575184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:40.575982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:40.578017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:40.636672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1103/2216] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 09:59:40 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 09:59:40.637910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:40.658436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb9975-717e-4268-9859-1f5284e74452 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:40.674859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:40.675655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:40.676064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:40.676898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:40.677650 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:40.679323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:40.693529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1114/2217] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:40.698050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:40.719241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b29cd5-ba7b-4073-be3b-4d1f2694d885 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:40.726206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:40.729237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:40.729499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:40.729787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] PATH_INFO: `/v3/projects/859d2901d15f409bb695482cb77b6f18/users/78c8df4238cd4df0a01754090d5bbf55/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:40.794034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859d2901d15f409bb695482cb77b6f18, user_id=78c8df4238cd4df0a01754090d5bbf55, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:40.798046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:40.824266 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1104/2218] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:40 2022] PUT /identity/v3/projects/859d2901d15f409bb695482cb77b6f18/users/78c8df4238cd4df0a01754090d5bbf55/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 09:59:40.828264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:40.849085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404655dd-0bea-4069-baea-a67f96d5fb30 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:40.962023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfe518-d2c5-46f0-b76e-0433dafc6688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:40.962826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfe518-d2c5-46f0-b76e-0433dafc6688 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:40.963106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfe518-d2c5-46f0-b76e-0433dafc6688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:40.963646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfe518-d2c5-46f0-b76e-0433dafc6688 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:40.965523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfe518-d2c5-46f0-b76e-0433dafc6688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:40.968516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfe518-d2c5-46f0-b76e-0433dafc6688 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:40.998023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1115/2219] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 09:59:40 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 09:59:40.998665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:41.013196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb039-0d62-452c-8384-ce9c7ea1dbc1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:41.019044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:41.028195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:41.028195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:41.028195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] PATH_INFO: `/v3/projects/859d2901d15f409bb695482cb77b6f18/users/78c8df4238cd4df0a01754090d5bbf55/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:41.028195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859d2901d15f409bb695482cb77b6f18, user_id=78c8df4238cd4df0a01754090d5bbf55, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:41.028195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:41.066172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1105/2220] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 09:59:40 2022] PUT /identity/v3/projects/859d2901d15f409bb695482cb77b6f18/users/78c8df4238cd4df0a01754090d5bbf55/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 09:59:43.801190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a82c-f5f4-4107-9ea9-8b2c072504c3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:43.802273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a82c-f5f4-4107-9ea9-8b2c072504c3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:43.802733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067a82c-f5f4-4107-9ea9-8b2c072504c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:43.845049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4067a82c-f5f4-4107-9ea9-8b2c072504c3 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:43.846277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4067a82c-f5f4-4107-9ea9-8b2c072504c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:43.930272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:44.020544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1116/2221] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:59:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 09:59:44.033345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:44.036594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:44.218162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc68b-d202-43f5-80bf-ebbe30252473 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:44.233306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d5c86-2386-40be-8eb8-4dc501d99e8b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:44.234297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5c86-2386-40be-8eb8-4dc501d99e8b service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:44.234995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5c86-2386-40be-8eb8-4dc501d99e8b service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:44.235499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d5c86-2386-40be-8eb8-4dc501d99e8b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:44.245406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d5c86-2386-40be-8eb8-4dc501d99e8b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:44.247445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97d5c86-2386-40be-8eb8-4dc501d99e8b service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:44.258200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1106/2222] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 09:59:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 09:59:50.395329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:50.396362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:50.396807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:50.432806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] MFA Rules not processed for user `f7bd2a6714544db69a8260388b39a890`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:50.437140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:50.600338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1117/2223] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:54.254185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=82,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:54.277657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f177a-53d7-4ae5-97b6-88cb42f8e344 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:54.278059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f177a-53d7-4ae5-97b6-88cb42f8e344 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:54.278773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f177a-53d7-4ae5-97b6-88cb42f8e344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:54.334751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b94f177a-53d7-4ae5-97b6-88cb42f8e344 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:54.339076 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b94f177a-53d7-4ae5-97b6-88cb42f8e344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:54.386661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1107/2224] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 09:59:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:54.404831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:54.425715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683afa8a-d435-4424-b241-d166aa793f6f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:54.457497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:54.458555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:54.459014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:54.462107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:54.493226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:54.497314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:54.533360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1118/2225] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 09:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 13 09:59:55.536145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b3e91-5d0e-44cb-a1dd-3bda29d1cc5c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:55.536590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b3e91-5d0e-44cb-a1dd-3bda29d1cc5c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:55.536590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b3e91-5d0e-44cb-a1dd-3bda29d1cc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:55.577863 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b90b3e91-5d0e-44cb-a1dd-3bda29d1cc5c None None] MFA Rules not processed for user `78c8df4238cd4df0a01754090d5bbf55`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 09:59:55.579738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b90b3e91-5d0e-44cb-a1dd-3bda29d1cc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:55.739004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1108/2226] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 09:59:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 09:59:55.754107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 09:59:55.756433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 09:59:55.951859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821dd1d-72ce-49ce-9938-63847467f858 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 09:59:55.965846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 09:59:55.966226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 09:59:55.966726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 09:59:55.967494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 09:59:56.177877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 09:59:56.182533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 09:59:56.196431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 09:59:56.217830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1119/2227] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 09:59:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:01.948435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3984-3eec-48c3-bd62-06835b7c883c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:01.948989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3984-3eec-48c3-bd62-06835b7c883c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:01.949149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02c3984-3eec-48c3-bd62-06835b7c883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:02.024122 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b02c3984-3eec-48c3-bd62-06835b7c883c None None] MFA Rules not processed for user `33dd51cac73b4712a8d0f4df9bfd0dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:02.032672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b02c3984-3eec-48c3-bd62-06835b7c883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:02.206597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1109/2228] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:06.202956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:12.185941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=62 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:15.122555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:15.124555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:15.188218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76cdd80-6907-4a06-b77c-4c68888e6dfe service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:15.193313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:15.194068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:15.194348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:15.194641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:15.196733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:15.271296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:15.272747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc699f-80f2-4282-95db-0f2b9bf408d7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:15.282800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1120/2229] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:00:25.278255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=50 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:27.862277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd593-fe3c-4855-a004-e92fc1f9a1bf None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:27.862841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd593-fe3c-4855-a004-e92fc1f9a1bf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:27.862947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cd593-fe3c-4855-a004-e92fc1f9a1bf None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:27.865172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1110/2230] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 10:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 10:00:27.872033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153697f2-3c4f-4fd3-958c-92ccbb9a200b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:27.872504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153697f2-3c4f-4fd3-958c-92ccbb9a200b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:27.872586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153697f2-3c4f-4fd3-958c-92ccbb9a200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:27.898251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-153697f2-3c4f-4fd3-958c-92ccbb9a200b None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:27.899501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-153697f2-3c4f-4fd3-958c-92ccbb9a200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:27.911564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1121/2231] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 10:00:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:27.929790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd593-fe3c-4855-a004-e92fc1f9a1bf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:27.931557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-559cd593-fe3c-4855-a004-e92fc1f9a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:27.996830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cd593-fe3c-4855-a004-e92fc1f9a1bf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:28.001313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd169d29-7c6b-4822-89c4-02a120943dbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:28.002159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd169d29-7c6b-4822-89c4-02a120943dbf service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.002621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd169d29-7c6b-4822-89c4-02a120943dbf service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.003184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd169d29-7c6b-4822-89c4-02a120943dbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.023029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd169d29-7c6b-4822-89c4-02a120943dbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:28.024879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd169d29-7c6b-4822-89c4-02a120943dbf service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:28.038245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1111/2232] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:28.114290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bcd87-8e1b-4741-8fc0-67ec772e4c37 None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.114614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bcd87-8e1b-4741-8fc0-67ec772e4c37 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.114896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6bcd87-8e1b-4741-8fc0-67ec772e4c37 None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.116388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1122/2233] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 10:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 10:00:28.122837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d1665-f3d6-4b61-89c4-eb7ba9cd31d4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.123134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d1665-f3d6-4b61-89c4-eb7ba9cd31d4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.123415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d1665-f3d6-4b61-89c4-eb7ba9cd31d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.151112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-156d1665-f3d6-4b61-89c4-eb7ba9cd31d4 None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:28.152622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-156d1665-f3d6-4b61-89c4-eb7ba9cd31d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:28.159499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1112/2234] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:28.172663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bcd87-8e1b-4741-8fc0-67ec772e4c37 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:28.186384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6bcd87-8e1b-4741-8fc0-67ec772e4c37 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:28.190348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c3954-b777-4ca8-a943-bfad3fce48c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:28.191114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3954-b777-4ca8-a943-bfad3fce48c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.191460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3954-b777-4ca8-a943-bfad3fce48c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.191741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3954-b777-4ca8-a943-bfad3fce48c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.200374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c3954-b777-4ca8-a943-bfad3fce48c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:28.201842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c3954-b777-4ca8-a943-bfad3fce48c6 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:28.211972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1123/2235] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:28.314920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085b14-46a8-4ef6-811f-63765e153d76 None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.315291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085b14-46a8-4ef6-811f-63765e153d76 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.315672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85085b14-46a8-4ef6-811f-63765e153d76 None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.317084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1113/2236] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 10:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 10:00:28.323415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.323740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.323970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.344088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:28.346386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:28.358256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1124/2237] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 10:00:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:28.369603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85085b14-46a8-4ef6-811f-63765e153d76 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:28.382379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85085b14-46a8-4ef6-811f-63765e153d76 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:28.385994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44098a38-32ed-4ddc-a8e1-47704cb01a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:28.386671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44098a38-32ed-4ddc-a8e1-47704cb01a0e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:28.386954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44098a38-32ed-4ddc-a8e1-47704cb01a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:28.387230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44098a38-32ed-4ddc-a8e1-47704cb01a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:28.398184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44098a38-32ed-4ddc-a8e1-47704cb01a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:28.399656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44098a38-32ed-4ddc-a8e1-47704cb01a0e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:28.410531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1114/2238] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:32.878282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:32.964124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3ab3b-c03a-491d-ba39-a9dde242db9d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:32.975856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:32.975856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:32.975856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:32.975856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] PATH_INFO: `/v3/users/abd663ccaea74a1e989548a4f97175c2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:32.976154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd663ccaea74a1e989548a4f97175c2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:32.976154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:33.036920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd82a7-8c98-4882-a86f-fbec891034d9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.037573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd82a7-8c98-4882-a86f-fbec891034d9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.037573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd82a7-8c98-4882-a86f-fbec891034d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:33.039775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd663ccaea74a1e989548a4f97175c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.054321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd663ccaea74a1e989548a4f97175c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.056480 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-16cd82a7-8c98-4882-a86f-fbec891034d9 None None] MFA Rules not processed for user `364d2064ce3a4a3aae9643ec962e5395`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:33.057779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-16cd82a7-8c98-4882-a86f-fbec891034d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.065210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd663ccaea74a1e989548a4f97175c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.070587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1115/2239] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:00:33.077727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd663ccaea74a1e989548a4f97175c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.078549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd663ccaea74a1e989548a4f97175c2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.086379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1125/2240] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:00:32 2022] DELETE /identity/v3/users/abd663ccaea74a1e989548a4f97175c2 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:00:33.090637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.091171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.091548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:33.110474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:33.112068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.194310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:33.198672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.198966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1116/2241] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:33.209622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:33.211168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.288259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76e8f12-3b74-4a0b-8a8b-016d567032f2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:33.294261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:33.295284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.295570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.295846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:33.299637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb73dcd-6b24-45e9-b619-8bed1a848580 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:33.307777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:33.309549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:33.315310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:33.317186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.317476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.317763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:33.320242 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.321808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1117/2242] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:00:33.328173 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:33.413612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:33.415291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ad49f-71fd-411f-89fa-884bbdd96ee1 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:33.427067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1126/2243] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:00:33.687772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:33.689256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.705922 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35dd6a-c5d1-44d5-b5cd-c145899abce6 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:33.727054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:33.728337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.728617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.728919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] PATH_INFO: `/v3/projects/3a1df4705f1d4626857e4b99336fe2b3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:33.730196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a1df4705f1d4626857e4b99336fe2b3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:33.732225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:33.757920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:33.811692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a1df4705f1d4626857e4b99336fe2b3', 'request_id': 'req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.819867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a1df4705f1d4626857e4b99336fe2b3', 'request_id': 'req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.828937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a1df4705f1d4626857e4b99336fe2b3', 'request_id': 'req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.843342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] The token cache is being invalidate because project 3a1df4705f1d4626857e4b99336fe2b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:00:33.843645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.844343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c11bac47-57d0-4d69-93f3-8b9d2f7e2be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:33.846306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1118/2244] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:00:33 2022] DELETE /identity/v3/projects/3a1df4705f1d4626857e4b99336fe2b3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:00:33.851587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.852080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.852384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:33.890822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:33.894018 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:33.989005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1127/2245] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:33.990255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:33.990692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:33.990952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.012301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:34.013514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:34.026490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1119/2246] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:34.033120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.049040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e4ea7-45f8-44c7-94b9-85165ac5547d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.057761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.058517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.059227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.059227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.059797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:00:34.060105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.061831 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.102657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1128/2247] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:00:34.106835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.116843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8e4b1a-a78a-4848-be82-ceabcf148aea None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.125183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.126192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.126691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.127120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.127985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.129921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.181923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1120/2248] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:00:34 2022] POST /identity/v3/projects => generated 373 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:00:34.188495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.200929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d769f9ac-c2af-44f0-8588-d397f54aed0f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.283094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.283972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.284434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.284970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.286180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.290105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.313902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1129/2249] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:00:34 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:00:34.318052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.333903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458b7278-7d27-43bf-b7d3-9b00361f81e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.341337 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.342187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.342713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.343082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.343925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.345606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.358911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1121/2250] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:00:34.363312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.375016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa40b3-7dc7-4736-9c5b-d0af125a9680 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.380495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbefd6b-5396-4f38-a801-5384bd84726f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.381474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefd6b-5396-4f38-a801-5384bd84726f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.382026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefd6b-5396-4f38-a801-5384bd84726f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.382314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbefd6b-5396-4f38-a801-5384bd84726f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.383275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefd6b-5396-4f38-a801-5384bd84726f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.384989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbefd6b-5396-4f38-a801-5384bd84726f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.396973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1130/2251] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:00:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:00:34.400917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.411382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7311c-8c2d-4288-8192-05a7765a46e6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.416576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.417578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.417898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.418167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] PATH_INFO: `/v3/projects/6c7e481000054934ac669b28b91fca2c/users/df900f961a254819a62df721a4f08013/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.436344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7e481000054934ac669b28b91fca2c, user_id=df900f961a254819a62df721a4f08013, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.439890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.458101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1122/2252] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:00:34 2022] PUT /identity/v3/projects/6c7e481000054934ac669b28b91fca2c/users/df900f961a254819a62df721a4f08013/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:00:34.469446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.469765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.469997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.489510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:34.501720 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] MFA Rules not processed for user `df900f961a254819a62df721a4f08013`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:34.503775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:34.595664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1131/2253] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:34.612539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.614330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:34.683576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078af469-6d09-4a14-a6a9-a97e45396674 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.688295 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e1807-35c9-454e-b91f-f15b89f91ac2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.689237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e1807-35c9-454e-b91f-f15b89f91ac2 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.690097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e1807-35c9-454e-b91f-f15b89f91ac2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.690356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e1807-35c9-454e-b91f-f15b89f91ac2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.705375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e1807-35c9-454e-b91f-f15b89f91ac2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.706942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28e1807-35c9-454e-b91f-f15b89f91ac2 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.717499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1123/2254] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:34.742381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:34.822599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a82b6c-8435-4cae-979e-3debba8154da None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:34.828050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:34.829015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.829198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.829474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] PATH_INFO: `/v3/users/df900f961a254819a62df721a4f08013` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.831162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df900f961a254819a62df721a4f08013)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:34.833125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:34.889880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df900f961a254819a62df721a4f08013'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:34.902448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df900f961a254819a62df721a4f08013'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:34.916067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df900f961a254819a62df721a4f08013'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:34.925663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df900f961a254819a62df721a4f08013'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:34.926461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df900f961a254819a62df721a4f08013'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:34.932783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1132/2255] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:00:34 2022] DELETE /identity/v3/users/df900f961a254819a62df721a4f08013 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:00:34.937429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:34.937724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:34.938000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:34.961829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:34.963374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:35.010954 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:35.036749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1124/2256] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:35.047311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:35.048839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:35.075871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:35.118750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9c820-2cef-4a72-b0f5-351426597db3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:35.122766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b176345-9015-46c8-b28b-d81c7f67f03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:35.123422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176345-9015-46c8-b28b-d81c7f67f03d service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:35.123703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176345-9015-46c8-b28b-d81c7f67f03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:35.123976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176345-9015-46c8-b28b-d81c7f67f03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:35.136644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176345-9015-46c8-b28b-d81c7f67f03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:35.138101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176345-9015-46c8-b28b-d81c7f67f03d service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:35.149741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1133/2257] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:35.570212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:35.572132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:35.587847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d247058-c9b6-4d3e-9ff3-d9aff6099069 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:35.592848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:35.593968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:35.594538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:35.594815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] PATH_INFO: `/v3/projects/6c7e481000054934ac669b28b91fca2c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:35.596467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7e481000054934ac669b28b91fca2c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:35.598453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:35.649626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7e481000054934ac669b28b91fca2c', 'request_id': 'req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:35.656389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7e481000054934ac669b28b91fca2c', 'request_id': 'req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:35.665413 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7e481000054934ac669b28b91fca2c', 'request_id': 'req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:35.676141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] The token cache is being invalidate because project 6c7e481000054934ac669b28b91fca2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:00:35.676429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:35.677057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff3e6df3-0b9b-4dfa-8bfd-e79f1916230a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:00:35.679204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1125/2258] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:00:35 2022] DELETE /identity/v3/projects/6c7e481000054934ac669b28b91fca2c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:00:35.683818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:35.684106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:35.684377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:35.703436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:35.704634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:35.779237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1134/2259] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:35.782565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:35.783511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:35.783870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:35.805434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:35.807041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:35.815554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1126/2260] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:35.821059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:35.832209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137468c6-03f8-48dd-b829-374474b5d59d None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:35.839714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:35.840410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:35.840728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:35.841025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:35.841773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:00:35.842076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:35.843814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:35.860647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1135/2261] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:00:35.869659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:35.880180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c79c76-dbad-4665-90f0-18b441231a7a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:35.887314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36550c39-b31a-494a-8eb2-891c6d6e9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:35.888098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36550c39-b31a-494a-8eb2-891c6d6e9a1a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:35.888455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36550c39-b31a-494a-8eb2-891c6d6e9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:35.888820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36550c39-b31a-494a-8eb2-891c6d6e9a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:35.889900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36550c39-b31a-494a-8eb2-891c6d6e9a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:35.891889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36550c39-b31a-494a-8eb2-891c6d6e9a1a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:35.925904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1127/2262] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:00:35 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:00:35.929689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:35.943055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf111a1b-ffe8-4fa8-b90d-03bb46e94a7f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:36.023456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.023645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.024085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.042289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:36.043026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.043352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.043683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.044691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:36.047316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:36.048926 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:36.050140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:36.075367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1136/2263] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:00:35 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:00:36.079425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:36.092691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eed09a-4ef1-42a2-a3c6-fa45b97ad68d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:36.098976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:36.099780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.100129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.100499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.101391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:36.103258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:36.118083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1137/2264] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:00:36.119345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:36.129894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003da49d-dff5-43ec-a855-5721913c3449 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:36.135464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:36.135984 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.136316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.137052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.137602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:36.138753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1128/2265] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:00:36.139382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:36.152854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1138/2266] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:00:36.156704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:36.169354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:36.171478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:36.173627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ce16d-a567-4260-8f19-64e0a3dde992 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:36.179844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee06266-a23b-4f6a-9a80-9f38d341c54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:36.181392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee06266-a23b-4f6a-9a80-9f38d341c54d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.181771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee06266-a23b-4f6a-9a80-9f38d341c54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.182119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee06266-a23b-4f6a-9a80-9f38d341c54d admin admin] PATH_INFO: `/v3/projects/9ca4bf8585be4c2ba2b0c3e60546beeb/users/8652548c3149485597a6c370e80eaf4a/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.206378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:36.210246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee06266-a23b-4f6a-9a80-9f38d341c54d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ca4bf8585be4c2ba2b0c3e60546beeb, user_id=8652548c3149485597a6c370e80eaf4a, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:36.213256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee06266-a23b-4f6a-9a80-9f38d341c54d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:36.228691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1129/2267] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:00:36 2022] PUT /identity/v3/projects/9ca4bf8585be4c2ba2b0c3e60546beeb/users/8652548c3149485597a6c370e80eaf4a/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:00:36.238852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.239146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.239427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.272766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] MFA Rules not processed for user `8652548c3149485597a6c370e80eaf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:36.274009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:36.277755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3f2a3-0036-4c6b-b3fe-c06ad348724b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:36.279858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:36.370243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13411d6b-7d8a-4f7f-9011-f5157a25b120 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:36.371141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13411d6b-7d8a-4f7f-9011-f5157a25b120 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.371634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13411d6b-7d8a-4f7f-9011-f5157a25b120 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.372016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13411d6b-7d8a-4f7f-9011-f5157a25b120 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.396324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1130/2268] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:00:36.409885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:36.412212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:36.485551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13411d6b-7d8a-4f7f-9011-f5157a25b120 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:36.487811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13411d6b-7d8a-4f7f-9011-f5157a25b120 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:36.497323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0117-5200-43aa-8f1d-cfbc25bc0544 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:36.503006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:36.503750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:36.504306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:36.505311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:36.511096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1139/2269] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:00:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:00:36.517693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:36.519734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:36.538608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1131/2270] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:00:38.124901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0797-55b2-4020-bc6e-4a2463657574 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:38.125464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0797-55b2-4020-bc6e-4a2463657574 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:38.125580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e0797-55b2-4020-bc6e-4a2463657574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:38.151504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-254e0797-55b2-4020-bc6e-4a2463657574 None None] MFA Rules not processed for user `8652548c3149485597a6c370e80eaf4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:00:38.152910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-254e0797-55b2-4020-bc6e-4a2463657574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:38.172803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1140/2271] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:00:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:00:46.529427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=50 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:48.141965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=76 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:00:50.914377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:00:50.917876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:51.050937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecdcd7-dc72-404e-bf0c-eb99f321305a service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:00:51.058556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:00:51.060403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:00:51.060705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:00:51.060988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:00:51.063620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:00:51.082884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:00:51.084579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:00:51.111481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1132/2272] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:00:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:01:01.093280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=32 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:01:03.485912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:03.486403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:03.486403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:03.504323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:03.505531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:03.512632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1141/2273] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 10:01:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:03.525762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:03.538082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc96c76f-1bc0-4945-ab00-d8a578866dff service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:03.544714 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363738a9-fcd0-4951-bfef-f280d23fc258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:03.545367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363738a9-fcd0-4951-bfef-f280d23fc258 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:03.545658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363738a9-fcd0-4951-bfef-f280d23fc258 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:03.545930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363738a9-fcd0-4951-bfef-f280d23fc258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:03.558556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363738a9-fcd0-4951-bfef-f280d23fc258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:03.560350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363738a9-fcd0-4951-bfef-f280d23fc258 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:03.569250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1133/2274] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:01:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:01:12.180007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:12.181668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:12.245898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c8e6-fcbc-4c7e-b28e-b270d792f3b9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:12.249898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:12.250580 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:12.250866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:12.251129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:12.253078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:12.320246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:12.321630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:12.332634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1142/2275] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:01:12 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:01:12.607517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804234-e4a4-4c57-ad6e-69c6ca82be5a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:12.608062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804234-e4a4-4c57-ad6e-69c6ca82be5a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:12.608062 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c804234-e4a4-4c57-ad6e-69c6ca82be5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:12.627007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5c804234-e4a4-4c57-ad6e-69c6ca82be5a None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:12.628206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5c804234-e4a4-4c57-ad6e-69c6ca82be5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:12.637063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1134/2276] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 10:01:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:12.653716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:12.666170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886eb723-e311-4985-a24e-a4a577a9811c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:12.671730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:12.672384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:12.672669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:12.672944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:12.682554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:12.684379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:12.694276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1143/2277] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:01:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:01:13.233956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30a665-9a0f-4f6d-90f6-b0f888a7e3da None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:13.234250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30a665-9a0f-4f6d-90f6-b0f888a7e3da None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:13.234553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30a665-9a0f-4f6d-90f6-b0f888a7e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:13.256231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ce30a665-9a0f-4f6d-90f6-b0f888a7e3da None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:13.257578 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ce30a665-9a0f-4f6d-90f6-b0f888a7e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:13.266599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1135/2278] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:13.279533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:13.290936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63db8562-0887-4e3b-a3e7-99f1e6d126f1 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:13.296286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:13.296940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:13.297217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:13.297490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:13.306654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:13.308255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:13.316936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1144/2279] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:01:13.533749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b5640-136e-4c46-8cda-8c12d5c32715 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:13.533924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b5640-136e-4c46-8cda-8c12d5c32715 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:13.534196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b5640-136e-4c46-8cda-8c12d5c32715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:13.553522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-989b5640-136e-4c46-8cda-8c12d5c32715 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:13.554892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-989b5640-136e-4c46-8cda-8c12d5c32715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:13.562177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1136/2280] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:13.574762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:13.586533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f36954-d584-4bb9-86f2-7e2507757213 service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:13.592211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:13.592868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:13.593183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:13.593483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:13.602625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:13.604271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:13.613393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1145/2281] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:01:13.950439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:13.950931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:13.951024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:13.969420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:13.970601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:13.979934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1137/2282] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 10:01:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:13.990572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:14.001438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5e2bf-ad76-4ea8-862f-7be78ea614fd service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:14.006851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c59436-16c3-4f5d-ae1f-e88a01a50291 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:14.007501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59436-16c3-4f5d-ae1f-e88a01a50291 service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:14.007856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59436-16c3-4f5d-ae1f-e88a01a50291 service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:14.008130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c59436-16c3-4f5d-ae1f-e88a01a50291 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:14.016923 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c59436-16c3-4f5d-ae1f-e88a01a50291 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:14.018608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c59436-16c3-4f5d-ae1f-e88a01a50291 service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:14.027203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1146/2283] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:01:16.329998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:16.403123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcbd826-35dc-4bb1-9c2f-dc5afa2e4e49 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:16.407874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:16.408781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:16.409057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:16.409327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] PATH_INFO: `/v3/users/8652548c3149485597a6c370e80eaf4a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:16.410622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8652548c3149485597a6c370e80eaf4a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:16.412740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:16.462625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8652548c3149485597a6c370e80eaf4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:16.475365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8652548c3149485597a6c370e80eaf4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:16.485361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8652548c3149485597a6c370e80eaf4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:16.486330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8652548c3149485597a6c370e80eaf4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:16.497679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8652548c3149485597a6c370e80eaf4a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:16.506591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1138/2284] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:01:16 2022] DELETE /identity/v3/users/8652548c3149485597a6c370e80eaf4a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:01:16.511258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06142-8ebd-4595-865b-12058762f173 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:16.511742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06142-8ebd-4595-865b-12058762f173 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:16.511873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a06142-8ebd-4595-865b-12058762f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:16.532701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-52a06142-8ebd-4595-865b-12058762f173 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:16.533862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-52a06142-8ebd-4595-865b-12058762f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:16.584875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:01:16.604313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1147/2285] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:01:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:16.614475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:16.616192 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:16.663350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:01:16.685428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85233ac6-caa2-48ce-97ce-e3bbf4b2a996 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:16.690672 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1658854-1bae-4f82-b773-43ae87e252c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:16.691354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1658854-1bae-4f82-b773-43ae87e252c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:16.691635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1658854-1bae-4f82-b773-43ae87e252c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:16.691914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1658854-1bae-4f82-b773-43ae87e252c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:16.702577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1658854-1bae-4f82-b773-43ae87e252c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:16.704032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1658854-1bae-4f82-b773-43ae87e252c2 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:16.714640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1139/2286] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:01:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:01:16.906306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a06142-8ebd-4595-865b-12058762f173 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:01:16.907877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-52a06142-8ebd-4595-865b-12058762f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:16.930108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a06142-8ebd-4595-865b-12058762f173 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:01:16.935812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:01:16.936700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:16.936986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:16.937262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] PATH_INFO: `/v3/projects/9ca4bf8585be4c2ba2b0c3e60546beeb` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:16.938606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ca4bf8585be4c2ba2b0c3e60546beeb)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:01:16.940711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:01:16.997174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ca4bf8585be4c2ba2b0c3e60546beeb', 'request_id': 'req-408e9651-a3d7-4809-a90a-c01ccee7dc56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:17.004470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ca4bf8585be4c2ba2b0c3e60546beeb', 'request_id': 'req-408e9651-a3d7-4809-a90a-c01ccee7dc56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:17.013832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ca4bf8585be4c2ba2b0c3e60546beeb', 'request_id': 'req-408e9651-a3d7-4809-a90a-c01ccee7dc56'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:17.026059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] The token cache is being invalidate because project 9ca4bf8585be4c2ba2b0c3e60546beeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:01:17.026344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:17.027034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-408e9651-a3d7-4809-a90a-c01ccee7dc56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:01:17.028891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1148/2287] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:01:16 2022] DELETE /identity/v3/projects/9ca4bf8585be4c2ba2b0c3e60546beeb => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:01:26.709754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:01:27.022822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:01:40.668682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c5719-0d01-4388-92c4-af48d0bffbac None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:40.669160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c5719-0d01-4388-92c4-af48d0bffbac None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:40.669287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c5719-0d01-4388-92c4-af48d0bffbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:40.688057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-247c5719-0d01-4388-92c4-af48d0bffbac None None] MFA Rules not processed for user `0dcfab314cf14d478e59c0b957193c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:40.689724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-247c5719-0d01-4388-92c4-af48d0bffbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:40.760989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1140/2288] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:01:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:49.751618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae48ac-3091-418c-ace1-377791690454 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:01:49.752140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae48ac-3091-418c-ace1-377791690454 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:01:49.752140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae48ac-3091-418c-ace1-377791690454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:01:49.772911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bcae48ac-3091-418c-ace1-377791690454 None None] MFA Rules not processed for user `33dd51cac73b4712a8d0f4df9bfd0dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:01:49.774141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bcae48ac-3091-418c-ace1-377791690454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:01:49.836817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1149/2289] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:01:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:01:50.751896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=25 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:01:59.829262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=25 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:02:04.702313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:04.703245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:04.703530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:04.722407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] MFA Rules not processed for user `c5ef575152d54c92af80295e1f89603d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:02:04.723746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:04.785111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1141/2290] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:02:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:02:14.777745 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=25 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:02:36.463668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:36.464189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:36.464296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:36.482553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] MFA Rules not processed for user `53afa795849e439b8497b9f388d5735e`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:02:36.483758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:36.543812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1150/2291] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:02:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:02:36.580452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:36.582222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:36.644029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa41da-3a7c-4ce7-b553-75e45ca54a53 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:36.647878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:36.648527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:36.648829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:36.649113 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:36.651025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:36.733233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:36.734712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:36.746035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1142/2292] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:02:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:02:36.758337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:36.759874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:36.824949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea13b76-4ef0-4e59-b382-9ffcce2e280f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:36.829868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:36.830561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:36.830840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:36.831538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:36.833013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:36.847279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:36.848741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc64fc-a878-43e3-a25f-43f0766d292b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:36.859938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1151/2293] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:02:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:02:46.741307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=54 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:02:46.855602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=51 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:02:46.914107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:46.915755 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:46.930815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e699c9-8a06-4fed-a874-46bcbd606307 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:46.938153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:46.938869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:46.939141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:46.939452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:46.941513 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:46.950595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:46.950894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:46.951175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:46.954138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:46.955877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:46.968227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1143/2294] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:02:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:02:46.970637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:02:46.971880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:47.030244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1152/2295] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 10:02:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:02:47.079521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:47.081013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:47.152176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8a4fb-130c-4d29-b092-219c3ba5b0f3 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:47.158212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:47.158880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:47.159163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:47.159440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:47.168353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:47.169944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:47.179081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1144/2296] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:02:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:02:51.024314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:51.026915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:51.046613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a209b-6921-4145-9ee5-f57a67770366 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:51.052624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:51.053286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:51.053695 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:51.053978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:51.056111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:51.068937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:51.071561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:51.091374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1153/2297] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:02:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:02:55.028727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:55.030912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:55.098743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae4ae1-8b23-4bbb-bc96-4daa4f241253 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:55.103850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:55.104720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:55.104996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:55.105264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] PATH_INFO: `/v3/users/f7bd2a6714544db69a8260388b39a890` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:55.106532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bd2a6714544db69a8260388b39a890)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:55.108524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:55.166877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bd2a6714544db69a8260388b39a890'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.180019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bd2a6714544db69a8260388b39a890'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.189087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bd2a6714544db69a8260388b39a890'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.189789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bd2a6714544db69a8260388b39a890'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.196501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:02:55.198562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bd2a6714544db69a8260388b39a890'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.206379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1145/2298] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:02:55 2022] DELETE /identity/v3/users/f7bd2a6714544db69a8260388b39a890 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:02:55.409473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:55.422785 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2880a-1fee-4c32-8728-3831e11023bc service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:55.495770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:55.496655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:55.496940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:55.497217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] PATH_INFO: `/v3/projects/8c3c440830e643b79fc1681dd4a9e2a6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:55.498398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3c440830e643b79fc1681dd4a9e2a6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:55.500504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:55.557245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3c440830e643b79fc1681dd4a9e2a6', 'request_id': 'req-a73b25b4-55a6-4706-8909-e5a017fe6432'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.564244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3c440830e643b79fc1681dd4a9e2a6', 'request_id': 'req-a73b25b4-55a6-4706-8909-e5a017fe6432'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.573304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3c440830e643b79fc1681dd4a9e2a6', 'request_id': 'req-a73b25b4-55a6-4706-8909-e5a017fe6432'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.587504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] The token cache is being invalidate because project 8c3c440830e643b79fc1681dd4a9e2a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:02:55.587859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.588541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.590322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1154/2299] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:02:55 2022] DELETE /identity/v3/projects/8c3c440830e643b79fc1681dd4a9e2a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:02:55.594309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:55.595898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:55.611947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2349c-f1c7-405b-a96d-a4a506c28cbb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:55.678788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:55.679770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:55.680151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:55.680529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] PATH_INFO: `/v3/users/beb8422305bf4b008056c38add4d4d93` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:55.681835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb8422305bf4b008056c38add4d4d93)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:55.684153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:55.735055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb8422305bf4b008056c38add4d4d93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.752453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb8422305bf4b008056c38add4d4d93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.765466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb8422305bf4b008056c38add4d4d93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.766071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb8422305bf4b008056c38add4d4d93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.773952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb8422305bf4b008056c38add4d4d93'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:55.780148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1146/2300] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:02:55 2022] DELETE /identity/v3/users/beb8422305bf4b008056c38add4d4d93 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:02:55.981105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:02:55.983134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:02:56.001949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b25b4-55a6-4706-8909-e5a017fe6432 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:02:56.023716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:02:56.070664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:02:56.071535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:02:56.071818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:02:56.072092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] PATH_INFO: `/v3/projects/ef4c84f286d148c7a8bc412b8afdf8d4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:02:56.073429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4c84f286d148c7a8bc412b8afdf8d4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:02:56.075388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:02:56.132714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4c84f286d148c7a8bc412b8afdf8d4', 'request_id': 'req-2a62e172-e46c-4213-8e1f-8ed456cb0b95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:56.140040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4c84f286d148c7a8bc412b8afdf8d4', 'request_id': 'req-2a62e172-e46c-4213-8e1f-8ed456cb0b95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:56.150344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4c84f286d148c7a8bc412b8afdf8d4', 'request_id': 'req-2a62e172-e46c-4213-8e1f-8ed456cb0b95'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:56.161317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] The token cache is being invalidate because project ef4c84f286d148c7a8bc412b8afdf8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:02:56.161601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:56.162235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:02:56.163828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1155/2301] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:02:55 2022] DELETE /identity/v3/projects/ef4c84f286d148c7a8bc412b8afdf8d4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:03:01.644057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:01.645522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:01.709125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6322-316c-4d65-aef4-382e3b668b41 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:01.739728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:03:01.763111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:01.764093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:01.764377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:01.764677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:01.766686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:01.776250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:01.777665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a949022-bfed-4f2a-aadf-be8c09cf8970 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:01.786128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1147/2302] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:04.175229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:04.176842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:04.258109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62e172-e46c-4213-8e1f-8ed456cb0b95 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:04.264312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:04.265005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:04.265282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:04.265554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:04.267749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:04.323087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:03:04.336467 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:04.338375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb975de5-d29a-463a-9d5e-409fd49035ae service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:04.348766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1156/2303] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:07.446839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9c0a-6ae6-4367-9cd7-0dc1106d693f None None] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.447377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9c0a-6ae6-4367-9cd7-0dc1106d693f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.447491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277a9c0a-6ae6-4367-9cd7-0dc1106d693f None None] PATH_INFO: `/` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.448978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1148/2304] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 10:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 10:03:07.455741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9cda-f36b-4ad8-b604-f4d0552072d0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.456282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9cda-f36b-4ad8-b604-f4d0552072d0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.456282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa9cda-f36b-4ad8-b604-f4d0552072d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.476149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5dfa9cda-f36b-4ad8-b604-f4d0552072d0 None None] MFA Rules not processed for user `70b8ca3066c649469fd409cae3fe9627`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:07.477353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5dfa9cda-f36b-4ad8-b604-f4d0552072d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:07.486456 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1157/2305] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:03:07.499798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a9c0a-6ae6-4367-9cd7-0dc1106d693f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:07.501768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-277a9c0a-6ae6-4367-9cd7-0dc1106d693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:07.521172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277a9c0a-6ae6-4367-9cd7-0dc1106d693f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:07.527494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52796ab-1f5b-42f1-9849-fa08cff16b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:07.528353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52796ab-1f5b-42f1-9849-fa08cff16b5b service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.528638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52796ab-1f5b-42f1-9849-fa08cff16b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.529004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52796ab-1f5b-42f1-9849-fa08cff16b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.537684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52796ab-1f5b-42f1-9849-fa08cff16b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:07.539607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52796ab-1f5b-42f1-9849-fa08cff16b5b service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:07.551441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1149/2306] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:03:07.693342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39797a-2403-49e6-bd01-6c57757a486e None None] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.693988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39797a-2403-49e6-bd01-6c57757a486e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.694454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39797a-2403-49e6-bd01-6c57757a486e None None] PATH_INFO: `/` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.696027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1158/2307] 10.222.0.17 () {54 vars in 921 bytes} [Wed Jul 13 10:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 13 10:03:07.714100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.714400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.714720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.737643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] MFA Rules not processed for user `339f9bc083674bf897023509101fc7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:07.747637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:07.750136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1150/2308] 10.222.0.17 () {58 vars in 1018 bytes} [Wed Jul 13 10:03:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:03:07.760903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39797a-2403-49e6-bd01-6c57757a486e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:07.772335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39797a-2403-49e6-bd01-6c57757a486e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:07.775899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a04e31-48fb-4eb7-b6db-ea469b1d1fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:07.776545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04e31-48fb-4eb7-b6db-ea469b1d1fda service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.776834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04e31-48fb-4eb7-b6db-ea469b1d1fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.777111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a04e31-48fb-4eb7-b6db-ea469b1d1fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.788452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04e31-48fb-4eb7-b6db-ea469b1d1fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:07.789948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a04e31-48fb-4eb7-b6db-ea469b1d1fda service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:07.801136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1159/2309] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:07.866744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:07.868220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:07.940169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc9c935-0cf6-4f8e-916e-56fde9c5a0d3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:07.945654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:07.946302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:07.946614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:07.946892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:07.948700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:07.961058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:07.962666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:07.972867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1151/2310] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:10.765419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6262-a52c-4ddd-bc79-6b9581ff01e4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:10.765924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6262-a52c-4ddd-bc79-6b9581ff01e4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:10.766016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031b6262-a52c-4ddd-bc79-6b9581ff01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:10.783920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-031b6262-a52c-4ddd-bc79-6b9581ff01e4 None None] MFA Rules not processed for user `33dd51cac73b4712a8d0f4df9bfd0dda`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:10.785170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-031b6262-a52c-4ddd-bc79-6b9581ff01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:10.841915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1160/2311] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:03:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:03:11.173273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:11.175064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:11.187390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62b1af-ad4f-4584-9e1d-c1410fbe76f9 service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:11.190933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:11.191569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:11.191853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:11.192201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:11.193964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:11.204344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:11.205765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:11.214733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1152/2312] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:13.796007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:13.796556 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:13.796651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:13.815211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] MFA Rules not processed for user `0dcfab314cf14d478e59c0b957193c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:13.816426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:13.874441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1161/2313] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:03:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:03:19.192120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:19.193651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:19.213592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7863c4-dd76-4f45-accb-4a09ddb5a626 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:19.225302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:19.226111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:19.226340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:19.226960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:19.228960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:19.242519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:19.244132 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6cf817-e728-43ed-8aed-b95305b94a5b service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:19.256346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1153/2314] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:21.934533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:21.966206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ae513-1a6a-4ec5-9f6d-25e4c76b729e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:21.974528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:21.975327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:21.976198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:21.976677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:21.979341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:21.993380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:21.995213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:22.008110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1162/2315] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:26.470511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:26.471023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:26.471101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:26.490360 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:26.491758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:26.552109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1154/2316] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 10:03:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:03:26.565661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:26.567211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:26.663186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a6b34-d547-461d-8ed3-52ee097355b4 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:26.672438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e91043b-b8c6-45b7-af89-e9d8daad74da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:26.673172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91043b-b8c6-45b7-af89-e9d8daad74da service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:26.673454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91043b-b8c6-45b7-af89-e9d8daad74da service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:26.673724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e91043b-b8c6-45b7-af89-e9d8daad74da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:26.681845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:03:26.685054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91043b-b8c6-45b7-af89-e9d8daad74da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:26.687877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e91043b-b8c6-45b7-af89-e9d8daad74da service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:26.699268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1163/2317] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:03:34.821758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:34.832258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:03:34.848355 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49905e6a-5ebc-41d8-8bad-cb3115bc67ee None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:34.862666 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:34.863677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:34.864050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:34.864584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:34.867356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:34.892656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:34.894752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:34.910682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1155/2318] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:36.523028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc8ac-ff3e-40d0-8be3-be71a452077b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:36.523548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc8ac-ff3e-40d0-8be3-be71a452077b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:36.523651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc8ac-ff3e-40d0-8be3-be71a452077b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:36.542805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-382cc8ac-ff3e-40d0-8be3-be71a452077b None None] MFA Rules not processed for user `364d2064ce3a4a3aae9643ec962e5395`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:36.544011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-382cc8ac-ff3e-40d0-8be3-be71a452077b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:36.600909 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1164/2319] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:03:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:03:36.941090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:36.958240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f3cd1-2ebf-4a58-b422-d04978cfbf5e service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:36.962233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:36.962934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:36.963214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:36.963476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:36.965514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:36.977667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:36.979215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:36.994600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1156/2320] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:03:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:03:43.502501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddb0b-96ce-4b03-b2dd-8ad472b3d0ed None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:43.503372 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddb0b-96ce-4b03-b2dd-8ad472b3d0ed None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:43.503800 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cddb0b-96ce-4b03-b2dd-8ad472b3d0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:43.524563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-57cddb0b-96ce-4b03-b2dd-8ad472b3d0ed None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:03:43.525778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-57cddb0b-96ce-4b03-b2dd-8ad472b3d0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:03:43.539342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1165/2321] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 10:03:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:03:43.548066 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:03:43.562912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4001338-a1da-42ef-9f19-15bc89bd8458 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:03:43.568281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:03:43.569092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:03:43.569479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:03:43.569830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:03:43.582521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:03:43.584811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:03:43.594289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1157/2322] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:03:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:03:53.518851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=30 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:03:53.590545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=17 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:02.161539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:02.161989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:02.162105 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:02.180062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:02.181240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:02.189470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1166/2323] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 10:04:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:02.216474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:02.229326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbb532-bdb9-42e4-abe8-ae9482eb5b0f service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:02.235667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:02.236312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:02.236595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:02.236869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:02.245869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:02.247525 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:02.256182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1158/2324] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:04:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:04:12.174887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:12.252588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=6 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:22.239823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:22.249851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a68a4-6463-402e-9ee8-41d3ac4558f0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:22.253700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:22.254385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:22.254705 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:22.255007 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:22.257676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:22.270460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:22.272239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:22.283758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1167/2325] 10.222.0.17 () {60 vars in 1396 bytes} [Wed Jul 13 10:04:22 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:25.572058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:25.583184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677a099-f753-4e62-82c3-e01944c096b4 service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:25.586962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:25.587866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:25.588146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:25.588420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:25.590288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:25.668547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:25.669950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:25.680056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1159/2326] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:27.030533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:27.040065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda472cf-694c-493f-a1f3-ba7f4b950d03 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:27.044446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:27.046473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:27.047076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:27.047358 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:27.049537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:27.062203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:27.064584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:27.076078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1168/2327] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:30.616679 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:30.629179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e852d7-9407-4580-9a0a-69392ac73a6a service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:30.634975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:30.635611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:30.635889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:30.636161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:30.638443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:30.650740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:30.652406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:30.663109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1160/2328] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:30.735450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:30.737761 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:30.750102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f52d3e-e6d8-45db-a3de-ab741376583d service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:30.755304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:30.756182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:30.756585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:30.756864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] PATH_INFO: `/v3/users/53afa795849e439b8497b9f388d5735e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:30.758177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=53afa795849e439b8497b9f388d5735e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:30.760080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:30.813115 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53afa795849e439b8497b9f388d5735e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:30.825562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53afa795849e439b8497b9f388d5735e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:30.841361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53afa795849e439b8497b9f388d5735e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:30.852034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53afa795849e439b8497b9f388d5735e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:30.852964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-25023a57-3b44-4d25-b0f7-4e33252106dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53afa795849e439b8497b9f388d5735e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:30.860036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1169/2329] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:30 2022] DELETE /identity/v3/users/53afa795849e439b8497b9f388d5735e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:31.040103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.051733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f63f7-6e45-4209-9cd5-f5238c524c7b service placement] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.116658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.117562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.117846 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.118121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] PATH_INFO: `/v3/projects/ef17643ceae44325a3f16cd3dcd8e3f8` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.119447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef17643ceae44325a3f16cd3dcd8e3f8)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.121370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:31.183705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef17643ceae44325a3f16cd3dcd8e3f8', 'request_id': 'req-f1c52d39-ef46-402c-bf09-330a3f96a278'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:31.201457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef17643ceae44325a3f16cd3dcd8e3f8', 'request_id': 'req-f1c52d39-ef46-402c-bf09-330a3f96a278'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:31.215198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef17643ceae44325a3f16cd3dcd8e3f8', 'request_id': 'req-f1c52d39-ef46-402c-bf09-330a3f96a278'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:31.246528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] The token cache is being invalidate because project ef17643ceae44325a3f16cd3dcd8e3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:31.246862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:31.247507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f1c52d39-ef46-402c-bf09-330a3f96a278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:31.252986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1161/2330] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:31 2022] DELETE /identity/v3/projects/ef17643ceae44325a3f16cd3dcd8e3f8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:31.254545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.255069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.255437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.291739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:31.293759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:31.479647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.480257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.480574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.507253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1170/2331] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:31.535757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:31.538514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:31.568751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1162/2332] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:31.574600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.587904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df77e43-bbd2-4f6f-9b30-28df1415336b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.594016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.594625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.595116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.595593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.596427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:31.596951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.598903 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:31.620042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1171/2333] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:31.628695 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.635564 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:31.642186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafaa592-0fd6-4e9d-ab99-e588a9106d72 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.648359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.649209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.649732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.650231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.651382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.653642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:31.696551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1163/2334] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:31 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:31.700719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.710983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c7896-1727-4377-a6e3-aa6b22d841b9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.757469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:31.789669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.790700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.791268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.791762 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.793156 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.795529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:31.823572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1172/2335] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:31 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:31.827518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.842148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f7a3f-c98c-4d9d-bdf7-a428c682a865 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.848409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.849627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.851876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.851876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.851876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.856044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:31.877172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1164/2336] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:31.880997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.893811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c302708-c6f5-4736-aafd-6f456c8e5087 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.899579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7bb0b6-62eb-4e1b-92a0-6fc4f5191621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.900562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb0b6-62eb-4e1b-92a0-6fc4f5191621 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.901260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb0b6-62eb-4e1b-92a0-6fc4f5191621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.901703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7bb0b6-62eb-4e1b-92a0-6fc4f5191621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.902814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bb0b6-62eb-4e1b-92a0-6fc4f5191621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.905506 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7bb0b6-62eb-4e1b-92a0-6fc4f5191621 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:31.921078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1173/2337] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:31.923861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:31.937730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5323fb5-415d-401d-8159-1d1d1737d7c6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:31.955082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:31.956292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:31.956786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:31.957273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] PATH_INFO: `/v3/projects/d5271a4ae4794a1894425531b6b5f1e6/users/75d1ade8d3ad443f8dbffac636b1e8ea/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:31.987474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5271a4ae4794a1894425531b6b5f1e6, user_id=75d1ade8d3ad443f8dbffac636b1e8ea, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:31.991074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.018474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1165/2338] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:31 2022] PUT /identity/v3/projects/d5271a4ae4794a1894425531b6b5f1e6/users/75d1ade8d3ad443f8dbffac636b1e8ea/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:32.027771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.028265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.028728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.080868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] MFA Rules not processed for user `75d1ade8d3ad443f8dbffac636b1e8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:32.082786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:32.219211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1174/2339] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:32.220899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.327340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a4e81-3200-4228-abf8-d366c8c0d75b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.336080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.336080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.336080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.336080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.339786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.340045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.392575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1166/2340] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:32 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:32.397387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.426386 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25b103-eb2a-4211-aa0e-c4444667889a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.527065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.527908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.528139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.528517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.530390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.533409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.551748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.553809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:32.570466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1175/2341] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:32 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:32.572551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.573105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13e94f-486b-44a0-bcea-930faa845f36 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.586572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c211f-fc13-4672-9efd-52a73732df4f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.591783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.592659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.592935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.593139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.594240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.596061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.607526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.611242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.611534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.612275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1176/2342] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:32.612971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] PATH_INFO: `/v3/users/0dcfab314cf14d478e59c0b957193c72` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.613727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.615212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcfab314cf14d478e59c0b957193c72)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.618713 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.627942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905720d-3f19-488e-9e4f-4981452d5409 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.667198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.668287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.668598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.669491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] PATH_INFO: `/v3/projects/5b47c92f7a3f4c91b6b1b415a4c83af7/users/bdd6d50391be46b68c3e37405c0758fb/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.690530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b47c92f7a3f4c91b6b1b415a4c83af7, user_id=bdd6d50391be46b68c3e37405c0758fb, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.697879 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.709767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcfab314cf14d478e59c0b957193c72'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:32.711068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:32.727852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1177/2343] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:32 2022] PUT /identity/v3/projects/5b47c92f7a3f4c91b6b1b415a4c83af7/users/bdd6d50391be46b68c3e37405c0758fb/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:32.734115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcfab314cf14d478e59c0b957193c72'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:32.735305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.743515 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcfab314cf14d478e59c0b957193c72'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:32.744036 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcfab314cf14d478e59c0b957193c72'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:32.752633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcfab314cf14d478e59c0b957193c72'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:32.761300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1167/2344] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:32 2022] DELETE /identity/v3/users/0dcfab314cf14d478e59c0b957193c72 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:32.824950 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3ee66-a98a-457b-8c96-714c10849339 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.903859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8575de1d-caf9-4209-93e8-db8be55d1694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.904725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575de1d-caf9-4209-93e8-db8be55d1694 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.905081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575de1d-caf9-4209-93e8-db8be55d1694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.905289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8575de1d-caf9-4209-93e8-db8be55d1694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.906122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575de1d-caf9-4209-93e8-db8be55d1694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.907953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8575de1d-caf9-4209-93e8-db8be55d1694 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.919422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1178/2345] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:32.923851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.925549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:32.936327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:32.941000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abd9ff-93f7-404b-bb73-bb448b422824 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:32.947810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:32.949324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.949722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.950155 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] PATH_INFO: `/v3/projects/5b47c92f7a3f4c91b6b1b415a4c83af7/users/bdd6d50391be46b68c3e37405c0758fb/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.952669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b47c92f7a3f4c91b6b1b415a4c83af7, user_id=bdd6d50391be46b68c3e37405c0758fb, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:32.955433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:32.968212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1168/2346] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:32 2022] PUT /identity/v3/projects/5b47c92f7a3f4c91b6b1b415a4c83af7/users/bdd6d50391be46b68c3e37405c0758fb/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:32.980287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:32.980626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:32.980889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:32.996283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:32.998197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.011360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] MFA Rules not processed for user `bdd6d50391be46b68c3e37405c0758fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:33.013258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.091836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1affdf-7895-4c33-960b-b98a8365ad4e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.096920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.097837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.098114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.098392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] PATH_INFO: `/v3/projects/96563cd3d5ff4d149c0db484f1d5c51d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.099918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96563cd3d5ff4d149c0db484f1d5c51d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.106627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1179/2347] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:33.106789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.116362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.118300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.153080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:33.172593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96563cd3d5ff4d149c0db484f1d5c51d', 'request_id': 'req-0fc51fa3-a6ec-4d27-a022-24d8f277576d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:33.183069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96563cd3d5ff4d149c0db484f1d5c51d', 'request_id': 'req-0fc51fa3-a6ec-4d27-a022-24d8f277576d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:33.195004 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96563cd3d5ff4d149c0db484f1d5c51d', 'request_id': 'req-0fc51fa3-a6ec-4d27-a022-24d8f277576d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:33.207148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] The token cache is being invalidate because project 96563cd3d5ff4d149c0db484f1d5c51d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:33.207442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:33.208887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0fc51fa3-a6ec-4d27-a022-24d8f277576d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:33.210871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1169/2348] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:32 2022] DELETE /identity/v3/projects/96563cd3d5ff4d149c0db484f1d5c51d => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:33.211001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cd38-429d-48e1-b795-445724caa6a8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.216587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daee85-1155-4c00-8921-edd1fac935be None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.216957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daee85-1155-4c00-8921-edd1fac935be None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.217242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15daee85-1155-4c00-8921-edd1fac935be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.237419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-15daee85-1155-4c00-8921-edd1fac935be None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:33.238659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-15daee85-1155-4c00-8921-edd1fac935be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.274665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.275318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.275759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.275888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.277715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.316138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1170/2349] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:33.323633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.323925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.324201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.341800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:33.343252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.351512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1171/2350] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:33.355416 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.356661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.358127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.364442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f3f4c-b6d9-46cc-bba4-c06f1d1f377a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.368794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1180/2351] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:33.375866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.376559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.376856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.377114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.378458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:33.378797 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.380521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.398726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1172/2352] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 10:04:33.399672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.411530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b675816-2291-4450-a9cd-048c95eecf3e service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.416282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.417718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.418070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.418497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.419207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.421234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.455405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1181/2353] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:33 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:33.464065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.469824 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:33.477105 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01a47b1-63e1-416e-b076-cccbd8cdb8a8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.559516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.560187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.560481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.560752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.561459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.563727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.599203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1173/2354] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:33 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:33.600559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.613090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8bc6b8-b978-4f3f-af1b-daf8814305b0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.619204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.619887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.620171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.620491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.621226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.622886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.636229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1182/2355] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:33.640793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.652287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83845a3f-b81d-4735-a4b3-615806a099c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.657465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f5ca8b-d7d2-4b98-8db0-a005fc8e3df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.658134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ca8b-d7d2-4b98-8db0-a005fc8e3df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.658444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ca8b-d7d2-4b98-8db0-a005fc8e3df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.658857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f5ca8b-d7d2-4b98-8db0-a005fc8e3df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.659627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ca8b-d7d2-4b98-8db0-a005fc8e3df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.661652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f5ca8b-d7d2-4b98-8db0-a005fc8e3df0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.676973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1174/2356] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:33.678202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.688537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296065c1-c63b-4db8-ba21-51b04dd12882 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.693092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.693974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.694247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.694544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] PATH_INFO: `/v3/projects/256e6b5611d44e0591ee64e6ef501183/users/89c794b297ec448b949b4e18ce71e277/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.710087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256e6b5611d44e0591ee64e6ef501183, user_id=89c794b297ec448b949b4e18ce71e277, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.712824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.726824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1183/2357] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:33 2022] PUT /identity/v3/projects/256e6b5611d44e0591ee64e6ef501183/users/89c794b297ec448b949b4e18ce71e277/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:33.736940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.737441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.737677 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.738955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.764991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] MFA Rules not processed for user `89c794b297ec448b949b4e18ce71e277`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:33.766405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.773652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:33.803265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1d18-b4b2-4205-afd4-7a51b6daef71 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.807846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd6d50391be46b68c3e37405c0758fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.808517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.808813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.809100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.809832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:33.810143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.811778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.824167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1184/2358] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 10:04:33.828294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.833808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1175/2359] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:33.839411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9835086-6e93-483e-8818-628c06d56044 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.844764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd6d50391be46b68c3e37405c0758fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.845027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.845470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.845708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.846013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.846392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:33.846734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.848769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.879976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1185/2360] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:33 2022] POST /identity/v3/projects => generated 353 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:33.881000 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:33.929291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67164213-efb2-439f-b3f5-3a020dfd0915 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.934942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:33.947234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeefe9d-2f81-4aad-ba70-4cd41fe9ba9e tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:33.952404 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd6d50391be46b68c3e37405c0758fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.953215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.953659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.953936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:33.954715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:33.955023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:33.956645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:33.972601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1186/2361] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 10:04:33.996344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:33.997001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:33.997279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:33.997552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:34.006490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:34.017617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa0b3f-b993-43ee-a0ff-b93d493c5084 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:34.022873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdd6d50391be46b68c3e37405c0758fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:34.023819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:34.024102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:34.024403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] PATH_INFO: `/v3/projects/c875a3e128aa4fba8b33d8ef747e63b0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:34.025691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c875a3e128aa4fba8b33d8ef747e63b0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:34.027651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:34.055877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:34.057686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:34.067586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1176/2362] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:34.078878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c875a3e128aa4fba8b33d8ef747e63b0', 'request_id': 'req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.086188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c875a3e128aa4fba8b33d8ef747e63b0', 'request_id': 'req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.095003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c875a3e128aa4fba8b33d8ef747e63b0', 'request_id': 'req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.106721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] The token cache is being invalidate because project c875a3e128aa4fba8b33d8ef747e63b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:34.107003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.107771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9d3f54ad-f8b6-41b3-aafd-10986aee16e4 tempest-VolumeQuotaClassesTest-2019939970 tempest-VolumeQuotaClassesTest-2019939970-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.109413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1187/2363] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:34 2022] DELETE /identity/v3/projects/c875a3e128aa4fba8b33d8ef747e63b0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:34.307288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:34.308983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:34.397896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ab9e2-c3ed-4caa-8b74-b42d471cc901 service nova] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:34.466366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:34.482301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:34.483296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:34.483618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:34.483895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] PATH_INFO: `/v3/users/75d1ade8d3ad443f8dbffac636b1e8ea` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:34.485130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75d1ade8d3ad443f8dbffac636b1e8ea)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:34.487280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:34.544607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75d1ade8d3ad443f8dbffac636b1e8ea'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.557056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75d1ade8d3ad443f8dbffac636b1e8ea'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.566989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75d1ade8d3ad443f8dbffac636b1e8ea'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.567670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75d1ade8d3ad443f8dbffac636b1e8ea'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.574667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75d1ade8d3ad443f8dbffac636b1e8ea'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:34.581994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1177/2364] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:34 2022] DELETE /identity/v3/users/75d1ade8d3ad443f8dbffac636b1e8ea => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:34.586555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:34.586849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:34.587140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:34.608718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:34.610082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:34.632560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:34.679673 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1188/2365] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:34.690089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:34.691557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:34.764407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873575-4f8d-4741-a02c-b356aa208a08 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:34.768725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:34.769384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:34.769767 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:34.770018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:34.779818 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:34.781427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:34.791627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1178/2366] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:35.083535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:35.085204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:35.101222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca323-680a-4108-a8c5-a7de3212a26e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:35.107475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:35.108450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:35.109334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:35.109334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] PATH_INFO: `/v3/projects/d5271a4ae4794a1894425531b6b5f1e6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:35.111350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5271a4ae4794a1894425531b6b5f1e6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:35.113898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:35.165850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5271a4ae4794a1894425531b6b5f1e6', 'request_id': 'req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.172487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5271a4ae4794a1894425531b6b5f1e6', 'request_id': 'req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.182704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5271a4ae4794a1894425531b6b5f1e6', 'request_id': 'req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.196155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] The token cache is being invalidate because project d5271a4ae4794a1894425531b6b5f1e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:35.196448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.197107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.198809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1189/2367] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:35 2022] DELETE /identity/v3/projects/d5271a4ae4794a1894425531b6b5f1e6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:35.203545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:35.214128 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943b7f-1b3f-4b87-97ef-dbeff124c3f3 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:35.273283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:35.274147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:35.274455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:35.274758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] PATH_INFO: `/v3/users/bdd6d50391be46b68c3e37405c0758fb` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:35.275953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdd6d50391be46b68c3e37405c0758fb)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:35.277860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:35.294106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:35.337350 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdd6d50391be46b68c3e37405c0758fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.353596 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdd6d50391be46b68c3e37405c0758fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.361608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdd6d50391be46b68c3e37405c0758fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.362364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdd6d50391be46b68c3e37405c0758fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.371806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-be21fb21-a297-4ae7-acba-a45f3656da88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdd6d50391be46b68c3e37405c0758fb'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.379143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1179/2368] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:35 2022] DELETE /identity/v3/users/bdd6d50391be46b68c3e37405c0758fb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:35.677765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:35.679666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:35.694189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887a2b7-a21f-4353-87ed-03a48d4cf8ab admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:35.779283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:35.780246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:35.780528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:35.780963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] PATH_INFO: `/v3/projects/5b47c92f7a3f4c91b6b1b415a4c83af7` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:35.782885 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b47c92f7a3f4c91b6b1b415a4c83af7)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:35.784962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:35.846169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:35.848126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'request_id': 'req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.855475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'request_id': 'req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.865696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b47c92f7a3f4c91b6b1b415a4c83af7', 'request_id': 'req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.880143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] The token cache is being invalidate because project 5b47c92f7a3f4c91b6b1b415a4c83af7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:35.880504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.881180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-620b2a51-161a-4f4a-b9d2-8c88f806dd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:35.882821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1190/2369] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:35 2022] DELETE /identity/v3/projects/5b47c92f7a3f4c91b6b1b415a4c83af7 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:35.888692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:35.889165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:35.889261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:35.907843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:35.909048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:35.969938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1180/2370] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:35.978245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:35.978479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:35.978764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:35.998452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:35.999801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:36.009626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1191/2371] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:36.014607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.025630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a41f7f-2f4c-4253-acbf-00215d82c38e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.031420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.032257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.032543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.032826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.033712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:36.034040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.035740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.050176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1181/2372] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:36.055015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.066680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb14b8a-6dcb-4fbb-8188-15993428538b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.072223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.072870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.073182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.073464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.074155 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.076134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.104066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1192/2373] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:36 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:36.113073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.126345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a07e00-3293-4dfb-82fe-bd78d59be0b3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.191538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.192246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.192527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.193475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.194167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.196127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.223770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1182/2374] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:36 2022] POST /identity/v3/users => generated 284 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:36.228237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.240009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269975-7f2c-4903-b759-e62a86234fff admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.244648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.245320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.245603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.245878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.246672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.248298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.260317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1193/2375] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:36.264904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.279817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b1131a-b167-4eec-ab8e-5a34aa136f0d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.285070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbfd364-8797-4c62-9a56-3dcf487f6ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.285724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd364-8797-4c62-9a56-3dcf487f6ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.286001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd364-8797-4c62-9a56-3dcf487f6ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.286272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbfd364-8797-4c62-9a56-3dcf487f6ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.287052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd364-8797-4c62-9a56-3dcf487f6ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.288757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbfd364-8797-4c62-9a56-3dcf487f6ed8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.294570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:36.306447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1183/2376] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:36.311312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.326087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff356f-c705-4b23-98e3-62ea69a9bd95 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.331492 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.332390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.332682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.332949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] PATH_INFO: `/v3/projects/27d1ade1ab874c9a9c8eea61b40124df/users/f0b6570b3366449ba4476041b1ec9876/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.349265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d1ade1ab874c9a9c8eea61b40124df, user_id=f0b6570b3366449ba4476041b1ec9876, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.351973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.366439 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1194/2377] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:36 2022] PUT /identity/v3/projects/27d1ade1ab874c9a9c8eea61b40124df/users/f0b6570b3366449ba4476041b1ec9876/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:36.377653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.377946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.378257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.410946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] MFA Rules not processed for user `f0b6570b3366449ba4476041b1ec9876`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:36.412172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:36.478807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1184/2378] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:36.485345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.555691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bde00-676a-46c2-b523-aab02ed80db2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.565100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.566623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.567120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.567474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.568578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.571791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.609911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1195/2379] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:36 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:36.611909 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.625626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b03159-4ac3-49fa-b132-3a478628fa73 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.695153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.695970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.696262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.696533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.697216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.699164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.722555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1185/2380] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:36 2022] POST /identity/v3/users => generated 290 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:36.727450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.742362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4f8b9-f0fd-469b-8a36-d7d14f40219b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.748454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.749357 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.749977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.750238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.750999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.752599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.764943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1196/2381] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:36.770018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.784237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e57fbd2-3ac9-44b3-9500-7dcb3247095f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.789340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.790222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.790532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.790810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] PATH_INFO: `/v3/projects/7471d53b9e2d4495b0362182bc88d53d/users/440e2d715356495d8a41282da971338d/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.806363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7471d53b9e2d4495b0362182bc88d53d, user_id=440e2d715356495d8a41282da971338d, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.808966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.826206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1186/2382] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:36 2022] PUT /identity/v3/projects/7471d53b9e2d4495b0362182bc88d53d/users/440e2d715356495d8a41282da971338d/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:36.830759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.840843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2200fb8-044e-4cdf-a70a-7f7b10d0e416 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.861506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.863502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:36.887436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:36.904280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.905017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.905304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.905576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.906473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.908059 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.922951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1197/2383] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:36.927270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:36.934742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:36.939359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a45045-8414-462e-ae8d-a1c0befc0704 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.940305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a74fa7-3519-41bf-9dd8-491c0f4faff4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:36.944838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84bd1a-00e8-4074-b358-8d75c647eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.945731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84bd1a-00e8-4074-b358-8d75c647eed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.945987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84bd1a-00e8-4074-b358-8d75c647eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.946270 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84bd1a-00e8-4074-b358-8d75c647eed4 admin admin] PATH_INFO: `/v3/projects/7471d53b9e2d4495b0362182bc88d53d/users/440e2d715356495d8a41282da971338d/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.948086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:36.948298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84bd1a-00e8-4074-b358-8d75c647eed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7471d53b9e2d4495b0362182bc88d53d, user_id=440e2d715356495d8a41282da971338d, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.949231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.949612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.949986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] PATH_INFO: `/v3/users/89c794b297ec448b949b4e18ce71e277` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:36.955934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d84bd1a-00e8-4074-b358-8d75c647eed4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.958408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c794b297ec448b949b4e18ce71e277)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:36.958408 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:36.973863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1198/2384] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:36 2022] PUT /identity/v3/projects/7471d53b9e2d4495b0362182bc88d53d/users/440e2d715356495d8a41282da971338d/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:36.975366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517407-949d-4763-881f-5f2d892efcdf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:36.976010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517407-949d-4763-881f-5f2d892efcdf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:36.976010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15517407-949d-4763-881f-5f2d892efcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:37.012318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-15517407-949d-4763-881f-5f2d892efcdf None None] MFA Rules not processed for user `440e2d715356495d8a41282da971338d`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:37.014058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-15517407-949d-4763-881f-5f2d892efcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:37.023913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c794b297ec448b949b4e18ce71e277'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:37.036022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c794b297ec448b949b4e18ce71e277'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:37.043241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c794b297ec448b949b4e18ce71e277'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:37.043915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c794b297ec448b949b4e18ce71e277'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:37.051340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c794b297ec448b949b4e18ce71e277'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:37.057274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1187/2385] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:36 2022] DELETE /identity/v3/users/89c794b297ec448b949b4e18ce71e277 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:37.058095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:37.059457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:37.088382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1199/2386] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:36 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:37.089683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:37.089971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:37.090248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:37.111485 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:37.112677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:37.125764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b265c1-8a3e-4284-a33d-c25c5d3de581 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:37.129595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:37.130281 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:37.130599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:37.130882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:37.132730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:37.178718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1200/2387] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:37.179613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:37.181253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:37.202779 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:37.204244 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:37.215385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1188/2388] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:37.216173 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:37.226289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a8428-8722-4228-86de-c9d984f12571 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:37.231274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:37.232027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:37.232397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:37.232766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:37.249112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:37.252198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:37.254878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9301e7-c6c9-401b-9738-d853da0acd3f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:37.258431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:37.259447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:37.259727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:37.260008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:37.269674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:37.272075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1189/2389] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:37.327429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:37.329388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:37.340228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1201/2390] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:37.433251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:37.444183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce7648-7376-42be-a6f0-c61142a6758d service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:37.447725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:37.448380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:37.448662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:37.448935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:37.450791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:37.462361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:37.525692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:37.527241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cd024-11ab-4aea-8ad9-4a0b37ef3231 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:37.538045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1190/2391] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:38.011856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.013986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:38.030052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a958b1-8743-43dd-8257-9c1c24d27d2f service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.034940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.035864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.036144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.036443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] PATH_INFO: `/v3/projects/256e6b5611d44e0591ee64e6ef501183` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.038308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256e6b5611d44e0591ee64e6ef501183)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.040238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.091235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256e6b5611d44e0591ee64e6ef501183', 'request_id': 'req-77892b57-5466-46b1-9011-b64383cae6b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:38.098008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256e6b5611d44e0591ee64e6ef501183', 'request_id': 'req-77892b57-5466-46b1-9011-b64383cae6b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:38.108934 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256e6b5611d44e0591ee64e6ef501183', 'request_id': 'req-77892b57-5466-46b1-9011-b64383cae6b9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:38.120076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] The token cache is being invalidate because project 256e6b5611d44e0591ee64e6ef501183 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:38.120802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:38.121033 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-77892b57-5466-46b1-9011-b64383cae6b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:38.123142 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1202/2392] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:38 2022] DELETE /identity/v3/projects/256e6b5611d44e0591ee64e6ef501183 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:38.128387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.128906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.129021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.150671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:38.152211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:38.218786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1191/2393] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:38.228435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85330-caf0-4977-a451-b02ad748226a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.228698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85330-caf0-4977-a451-b02ad748226a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.228986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85330-caf0-4977-a451-b02ad748226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.249120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-aec85330-caf0-4977-a451-b02ad748226a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:38.250607 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-aec85330-caf0-4977-a451-b02ad748226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:38.260415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1203/2394] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:38.265272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.275369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a94113-ab85-4c7b-bde8-7a96996a2dc4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.280039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.280694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.281045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.281275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.282025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:38.282330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.283990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.297093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1192/2395] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:38.300786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec85330-caf0-4977-a451-b02ad748226a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.310383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec85330-caf0-4977-a451-b02ad748226a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.315068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.315763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.316045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.316321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.317048 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.319009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.347017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1204/2396] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:38.351123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.361624 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702e4eb3-89fb-419b-89fb-d78faa938230 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.424848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.425573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.425867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.426393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.427216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.429086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.453252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1193/2397] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:38.457356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.468507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33acf4-84ad-4995-a2e8-0650d150367f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.475680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.476474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.476752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.477083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.478093 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.479748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.492615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1205/2398] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:38.496514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.506710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b3131-462a-4ef1-8e99-326a150fa11d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.511463 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f18497-dbd2-4773-84f9-7eec8a503c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.512126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f18497-dbd2-4773-84f9-7eec8a503c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.512396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f18497-dbd2-4773-84f9-7eec8a503c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.512670 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f18497-dbd2-4773-84f9-7eec8a503c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.513697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f18497-dbd2-4773-84f9-7eec8a503c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.515359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f18497-dbd2-4773-84f9-7eec8a503c50 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.530534 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1194/2399] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:38.534970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.546955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b230fb3-e7b3-4441-a8a7-4101bc3de28f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.552852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.554079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.554838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.555411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] PATH_INFO: `/v3/projects/17afd5240ad542198e38e892f75176ba/users/d9740f5204964e7eb45a7951a8ca0c69/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.576920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17afd5240ad542198e38e892f75176ba, user_id=d9740f5204964e7eb45a7951a8ca0c69, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.580022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.595906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1206/2400] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:38 2022] PUT /identity/v3/projects/17afd5240ad542198e38e892f75176ba/users/d9740f5204964e7eb45a7951a8ca0c69/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:38.606504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.606901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.607243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.638232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] MFA Rules not processed for user `d9740f5204964e7eb45a7951a8ca0c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:38.639504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:38.645650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:38.718101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1195/2401] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:38.722700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.752588 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:38.792537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef1b0e-e006-46d0-a199-f534c789a287 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.797634 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.798334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.798630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.798925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.799617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.801570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.828988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1207/2402] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:38.832971 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.844760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0a6d9-b610-4fc7-bd2a-1e0c0ae4b01d None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.931804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.932570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.934074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.934074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.934074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.935995 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:38.958335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1196/2403] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:38 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:38.963195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:38.975890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028d5ee-ad04-4b75-b5a8-fe21869962e1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:38.981835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:38.982717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:38.983074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:38.983422 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:38.984801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:38.986949 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.000927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1208/2404] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:39.005428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.017618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c7c90-2321-408d-b204-b0ca062df907 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.022758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437ee23-0188-4a01-a563-20d33960d969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.023551 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437ee23-0188-4a01-a563-20d33960d969 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.024163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437ee23-0188-4a01-a563-20d33960d969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.024456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437ee23-0188-4a01-a563-20d33960d969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.025420 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437ee23-0188-4a01-a563-20d33960d969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.027175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437ee23-0188-4a01-a563-20d33960d969 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.044738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1197/2405] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:39.051803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.064176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d427c4-8fe0-49ee-99e0-98240a7893d2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.073164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.074368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.074599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.075088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] PATH_INFO: `/v3/projects/dd419160c32c428fbe6aa1dbc3ff85f9/users/f831c86a15d54127abf4b91ad3cbd2d2/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.098432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd419160c32c428fbe6aa1dbc3ff85f9, user_id=f831c86a15d54127abf4b91ad3cbd2d2, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.101717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.124196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1209/2406] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:39 2022] PUT /identity/v3/projects/dd419160c32c428fbe6aa1dbc3ff85f9/users/f831c86a15d54127abf4b91ad3cbd2d2/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:39.135252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.136154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.136657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.196906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] MFA Rules not processed for user `f831c86a15d54127abf4b91ad3cbd2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:39.198614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:39.279595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1198/2407] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:39.284379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.357063 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd608b31-e9db-41eb-9347-9d9c0ca89538 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.362206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.367595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.367595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.367595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.367595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.367595 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.401484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1210/2408] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:39 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:39.405252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.428947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a0cf9-9516-4215-99a9-d82b9ee96ea2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.447306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:39.511261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.512265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.512552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.513169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.514104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.516227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.543956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1199/2409] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:39 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:39.545127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.557338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e23dbd6-20a4-4e9b-ad1f-8e0ed3649493 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.563243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.564774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.564774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.564774 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.566466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.567090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.579319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1211/2410] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:39.583709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.594544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846dda0-c9ab-455f-a28a-150886e78144 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.599898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.601945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.601945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.601945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] PATH_INFO: `/v3/projects/d5ce0032835c4eaf8098cbe3c4deea65/users/afcd3ccfc04b46dba15a25c3ddcf4f91/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.620593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ce0032835c4eaf8098cbe3c4deea65, user_id=afcd3ccfc04b46dba15a25c3ddcf4f91, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.623390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.643915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1200/2411] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:39 2022] PUT /identity/v3/projects/d5ce0032835c4eaf8098cbe3c4deea65/users/afcd3ccfc04b46dba15a25c3ddcf4f91/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:39.647780 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.659258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a10f7-0c92-4f26-8225-2df0f83414a6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.712228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:39.729108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94c421-7df5-4ec6-8e45-e74812bfeadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.729940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c421-7df5-4ec6-8e45-e74812bfeadc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.730237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c421-7df5-4ec6-8e45-e74812bfeadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.730554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c421-7df5-4ec6-8e45-e74812bfeadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.731553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94c421-7df5-4ec6-8e45-e74812bfeadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.733714 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94c421-7df5-4ec6-8e45-e74812bfeadc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.744712 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1212/2412] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:39.749041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.760710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d8bdbf-e372-4fe7-be71-7eea96dc7acd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.766090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.767048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.767326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.767603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] PATH_INFO: `/v3/projects/d5ce0032835c4eaf8098cbe3c4deea65/users/afcd3ccfc04b46dba15a25c3ddcf4f91/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.769604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ce0032835c4eaf8098cbe3c4deea65, user_id=afcd3ccfc04b46dba15a25c3ddcf4f91, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.772300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:39.783872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1201/2413] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:39 2022] PUT /identity/v3/projects/d5ce0032835c4eaf8098cbe3c4deea65/users/afcd3ccfc04b46dba15a25c3ddcf4f91/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:39.795413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.795692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.795968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.825157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] MFA Rules not processed for user `afcd3ccfc04b46dba15a25c3ddcf4f91`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:39.826784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:39.900539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1213/2414] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:39.911810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:39.913496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:39.976472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcb7be-99eb-447a-9681-c0b7fdc4d3f6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:39.980184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:39.980873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:39.981159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:39.981432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:39.991883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:39.993368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:40.003876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1202/2415] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:40.671133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:40.681540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122eedd7-ad95-4e9f-abcf-19d1d1f1f90c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:40.685399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:40.686052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:40.686330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:40.686637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:40.770078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:40.771771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:40.808116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1214/2416] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:41.175246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:41.176790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:41.287164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19559523-73a8-41fd-a227-cdf7c37571f0 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:41.292035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:41.292914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:41.293195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:41.293471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] PATH_INFO: `/v3/users/33dd51cac73b4712a8d0f4df9bfd0dda` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:41.294773 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33dd51cac73b4712a8d0f4df9bfd0dda)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:41.296887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:41.309283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:41.352075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33dd51cac73b4712a8d0f4df9bfd0dda'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.365472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33dd51cac73b4712a8d0f4df9bfd0dda'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.374854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33dd51cac73b4712a8d0f4df9bfd0dda'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.376052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33dd51cac73b4712a8d0f4df9bfd0dda'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.385611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-52f79238-11bc-4d35-abf3-a01ad7b01e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33dd51cac73b4712a8d0f4df9bfd0dda'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.397955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1203/2417] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:41 2022] DELETE /identity/v3/users/33dd51cac73b4712a8d0f4df9bfd0dda => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:41.595233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:41.615377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21e6cb-6ec0-4a18-8509-c21ebc021622 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:41.681307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:41.682174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:41.682558 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:41.682839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] PATH_INFO: `/v3/projects/9fc3a6dd6ff1438f88fe786a71a735de` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:41.684112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc3a6dd6ff1438f88fe786a71a735de)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:41.685946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:41.698060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:41.739098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc3a6dd6ff1438f88fe786a71a735de', 'request_id': 'req-e5395c66-31dc-4e90-8033-6152003b6418'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.745523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc3a6dd6ff1438f88fe786a71a735de', 'request_id': 'req-e5395c66-31dc-4e90-8033-6152003b6418'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.753828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc3a6dd6ff1438f88fe786a71a735de', 'request_id': 'req-e5395c66-31dc-4e90-8033-6152003b6418'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.768557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] The token cache is being invalidate because project 9fc3a6dd6ff1438f88fe786a71a735de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:41.768845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.769462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-e5395c66-31dc-4e90-8033-6152003b6418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:41.771158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1215/2418] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:41 2022] DELETE /identity/v3/projects/9fc3a6dd6ff1438f88fe786a71a735de => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:41.776172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:41.776487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:41.776765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:41.795898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:41.797626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:41.863238 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1204/2419] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:41.871608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:41.871893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:41.872172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:41.901181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:41.903017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:41.913942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1216/2420] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:41.918535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:41.929612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3ab0e-3802-42f3-846e-08312e5e3ff3 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:41.935786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:41.936389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:41.936669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:41.937189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:41.937925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:41.938232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:41.939947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:41.952743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1205/2421] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:41.957596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:41.967227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bdb4b-befd-4a8d-9920-454f5ba555d7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:41.973045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:41.973696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:41.973976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:41.974248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:41.974958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:41.976912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.006518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1217/2422] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:41 2022] POST /identity/v3/projects => generated 357 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:42.011028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.027456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a095574-b263-4764-8ae2-5722d7677f0c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.088260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.088917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.089193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.089465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.090154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.092097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.113426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1206/2423] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:42 2022] POST /identity/v3/users => generated 279 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:42.117507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.128406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c959751-a909-4c88-8f30-87a1611eb5c6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.134247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.134948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.135225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.135494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.136215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.138081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.149173 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1218/2424] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:42.153172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.160074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:42.163900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a31c27-8724-4a34-ab20-4140f25a4a32 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.170072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216d522-9419-4176-8230-387ac74e95f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.170878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d522-9419-4176-8230-387ac74e95f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.171424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d522-9419-4176-8230-387ac74e95f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.171906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216d522-9419-4176-8230-387ac74e95f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.172801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d522-9419-4176-8230-387ac74e95f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.174721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216d522-9419-4176-8230-387ac74e95f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.184861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1207/2425] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:42.189167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.199214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a338ce-ebe5-46bf-bdcd-68b8aa746397 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.203759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.204636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.204914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.205181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] PATH_INFO: `/v3/projects/ef8a56f8e62143b686935e4229c2c450/users/bb270a21607f403f8e003732423dfbee/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.221734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8a56f8e62143b686935e4229c2c450, user_id=bb270a21607f403f8e003732423dfbee, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.224591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.239808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1219/2426] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:42 2022] PUT /identity/v3/projects/ef8a56f8e62143b686935e4229c2c450/users/bb270a21607f403f8e003732423dfbee/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:42.250996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.251275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.251556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.282333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] MFA Rules not processed for user `bb270a21607f403f8e003732423dfbee`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:42.283476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:42.349662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1208/2427] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:42.354066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.430478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb8576-be92-4896-b38a-b23aef846f3a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.436530 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.444781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.444781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.444781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.444781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.444781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.467496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1220/2428] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:42 2022] POST /identity/v3/projects => generated 355 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:42.479934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.492975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381cc1d6-96b0-4b8e-8626-364532e53b39 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.560584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.561268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.561556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.561882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.562667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.564708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.587592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1209/2429] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:42 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:42.591948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.603847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb9827-b56f-4508-bd8c-969ee0adaafb admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.609968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.610742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.611027 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.611298 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.612249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.614119 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.630605 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1221/2430] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:42.634708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.648964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b944c13d-cef0-453e-abab-ebf849a262c5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.653944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.654929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.655229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.655512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] PATH_INFO: `/v3/projects/ae38eb6c782e440ca0095cb47c46d88d/users/e209be3d5d2e4be4aeac7aa1d3f54966/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.673892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae38eb6c782e440ca0095cb47c46d88d, user_id=e209be3d5d2e4be4aeac7aa1d3f54966, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.676585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.690883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1210/2431] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:42 2022] PUT /identity/v3/projects/ae38eb6c782e440ca0095cb47c46d88d/users/e209be3d5d2e4be4aeac7aa1d3f54966/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:42.695084 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.708121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ebb6b4-7745-4b5b-9979-616a1caa0567 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.715627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:42.716753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.719723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:42.771079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:42.772249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.772929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.773246 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.773537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.774262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.776136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.790200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1222/2432] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:42.790394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de5992-697b-462d-85ee-bec926f33d1a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.791360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.794178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.795082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.795366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.795640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] PATH_INFO: `/v3/users/f0b6570b3366449ba4476041b1ec9876` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.797411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b6570b3366449ba4476041b1ec9876)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.799519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.801384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517effc9-45bc-4afd-9c7c-34f577280f30 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:42.806057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c66bf3-28f6-4c37-a72b-2c3be98384a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:42.806974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66bf3-28f6-4c37-a72b-2c3be98384a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.807258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66bf3-28f6-4c37-a72b-2c3be98384a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.807537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c66bf3-28f6-4c37-a72b-2c3be98384a6 admin admin] PATH_INFO: `/v3/projects/ae38eb6c782e440ca0095cb47c46d88d/users/e209be3d5d2e4be4aeac7aa1d3f54966/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.809535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c66bf3-28f6-4c37-a72b-2c3be98384a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae38eb6c782e440ca0095cb47c46d88d, user_id=e209be3d5d2e4be4aeac7aa1d3f54966, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:42.812403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c66bf3-28f6-4c37-a72b-2c3be98384a6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:42.823075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1223/2433] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:42 2022] PUT /identity/v3/projects/ae38eb6c782e440ca0095cb47c46d88d/users/e209be3d5d2e4be4aeac7aa1d3f54966/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:42.833453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.833742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.834017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.856728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b6570b3366449ba4476041b1ec9876'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:42.861256 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] MFA Rules not processed for user `e209be3d5d2e4be4aeac7aa1d3f54966`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:42.862498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:42.869472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b6570b3366449ba4476041b1ec9876'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:42.878873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b6570b3366449ba4476041b1ec9876'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:42.879581 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b6570b3366449ba4476041b1ec9876'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:42.886997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3f55ccb7-897f-4106-92a0-0fd65c986dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b6570b3366449ba4476041b1ec9876'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:42.893654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1211/2434] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:42 2022] DELETE /identity/v3/users/f0b6570b3366449ba4476041b1ec9876 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:42.897996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:42.898307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:42.898612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:42.915473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:42.916644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:42.935464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1224/2435] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:42.947095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.948398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:42.982385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1212/2436] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:42.992044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:42.993381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:43.008618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20f8e5-f110-4c68-815b-cb5234f30685 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:43.041704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:43.055802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661b087-21f5-43f1-b715-52526e08f177 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:43.059673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:43.060324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:43.060604 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:43.060928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:43.068793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:43.069471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:43.069781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:43.070056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:43.071460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:43.072940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:43.083508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1213/2437] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:43.133856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:43.135339 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:43.146382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1225/2438] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:42 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:43.221841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:43.244890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af55a-9bf1-481d-bd26-579f47f7c2ac service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:43.248602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:43.249249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:43.250116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:43.250456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:43.252299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:43.261993 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:43.319171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:43.320617 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:43.330347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1214/2439] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:43 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:43.363657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:43.365182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:43.383784 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bd7e9-c8f2-4a7c-8a01-7726bb339d10 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:43.389343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:43.390355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:43.390798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:43.391197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] PATH_INFO: `/v3/projects/27d1ade1ab874c9a9c8eea61b40124df` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:43.393276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d1ade1ab874c9a9c8eea61b40124df)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:43.396057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:43.448990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d1ade1ab874c9a9c8eea61b40124df', 'request_id': 'req-73678f10-1fce-4e94-8070-00fe103d6b74'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.463001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d1ade1ab874c9a9c8eea61b40124df', 'request_id': 'req-73678f10-1fce-4e94-8070-00fe103d6b74'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.473602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d1ade1ab874c9a9c8eea61b40124df', 'request_id': 'req-73678f10-1fce-4e94-8070-00fe103d6b74'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.490801 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] The token cache is being invalidate because project 27d1ade1ab874c9a9c8eea61b40124df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:43.491888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.492748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.494744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1226/2440] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:43 2022] DELETE /identity/v3/projects/27d1ade1ab874c9a9c8eea61b40124df => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:43.499149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:43.520048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db908755-d3b1-4144-8272-e24aa0b4c2c2 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:43.592017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:43.592913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:43.593256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:43.593542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] PATH_INFO: `/v3/users/440e2d715356495d8a41282da971338d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:43.594861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] RBAC: Authorizing `identity:delete_user(user_id=440e2d715356495d8a41282da971338d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:43.596798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:43.654949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '440e2d715356495d8a41282da971338d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.670887 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '440e2d715356495d8a41282da971338d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.679793 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '440e2d715356495d8a41282da971338d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.680561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '440e2d715356495d8a41282da971338d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.688911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e27c2918-4787-4572-8c3f-c6c7b464b948 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '440e2d715356495d8a41282da971338d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:43.696913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1215/2441] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:43 2022] DELETE /identity/v3/users/440e2d715356495d8a41282da971338d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:44.047613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.049316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:44.065491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73678f10-1fce-4e94-8070-00fe103d6b74 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.129391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.130257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.130578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.130845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] PATH_INFO: `/v3/projects/7471d53b9e2d4495b0362182bc88d53d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.132053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7471d53b9e2d4495b0362182bc88d53d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.134012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.142572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:44.184147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7471d53b9e2d4495b0362182bc88d53d', 'request_id': 'req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:44.190946 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7471d53b9e2d4495b0362182bc88d53d', 'request_id': 'req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:44.200223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7471d53b9e2d4495b0362182bc88d53d', 'request_id': 'req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:44.210617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] The token cache is being invalidate because project 7471d53b9e2d4495b0362182bc88d53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:44.210898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:44.211511 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d361b8e6-ecee-4f2c-895f-3bbcb4bacf77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:44.213049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1227/2442] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:44 2022] DELETE /identity/v3/projects/7471d53b9e2d4495b0362182bc88d53d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:44.218292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.218856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.219257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.238159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:44.239356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:44.273187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:44.311898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1216/2443] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:44.320261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.320557 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.320957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.341278 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:44.342550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:44.353394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1228/2444] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:44.357876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.369455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedc037-4091-424e-bdf0-a22cc0ef8967 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.376817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.376944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.377163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.377442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.378179 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:44.378542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.380153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.393186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1217/2445] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:44.397667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.407707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8579957-3cd5-45d2-bb42-07098404759b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.412874 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.413536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.413815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.414092 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.414842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.416816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.447214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1229/2446] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:44 2022] POST /identity/v3/projects => generated 359 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:44.448366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.458839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e109abc1-8153-435b-a8e4-a72f26f3bd0a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.516852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.517524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.517808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.518124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.518827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.520742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.542825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1218/2447] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:44 2022] POST /identity/v3/users => generated 280 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:44.545626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.556503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feac50a-9747-439e-821c-aa29509ab72e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.561317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.562121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.562431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.562777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.563550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.565132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.576402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1230/2448] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:44.580758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.591706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd7969-2560-4e0f-93a2-f35409e0d3e3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.598801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1596-6c26-4339-9cd0-be4bd3001ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.599565 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1596-6c26-4339-9cd0-be4bd3001ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.599885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1596-6c26-4339-9cd0-be4bd3001ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.600156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1596-6c26-4339-9cd0-be4bd3001ab5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.600941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc1596-6c26-4339-9cd0-be4bd3001ab5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.602626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc1596-6c26-4339-9cd0-be4bd3001ab5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.613891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1219/2449] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:44.618899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.629635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf1c619-c27a-4609-bfcf-9ba0b544ff4b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.635346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.636307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.636576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.636892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] PATH_INFO: `/v3/projects/760e7b86c9dd4010a6ab9c064d81a047/users/78e584a56da94132b743effc2d505ca0/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.654929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] RBAC: Authorizing `identity:create_grant(project_id=760e7b86c9dd4010a6ab9c064d81a047, user_id=78e584a56da94132b743effc2d505ca0, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.658143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.675590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1231/2450] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:44 2022] PUT /identity/v3/projects/760e7b86c9dd4010a6ab9c064d81a047/users/78e584a56da94132b743effc2d505ca0/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:44.685897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.686233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.686554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.716778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] MFA Rules not processed for user `78e584a56da94132b743effc2d505ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:44.718140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:44.787110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1220/2451] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:44.824203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.826699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:44.895496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db9af3-6839-46d3-98ef-7abbf147949c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:44.899476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:44.900260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:44.900571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:44.900807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:44.911039 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:44.912522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:44.922952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1232/2452] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:44.947614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:44.976321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:45.024811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88503f-c866-4705-8d28-faa224e33bed None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:45.029866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:45.031102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:45.031529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:45.031874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] PATH_INFO: `/v3/users/78e584a56da94132b743effc2d505ca0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:45.033268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78e584a56da94132b743effc2d505ca0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:45.035587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:45.072663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:45.087683 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287b125-dc76-444d-b0e6-c3c421d5bf4d service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:45.092110 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:45.094034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:45.094249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:45.094581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:45.096441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:45.107011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78e584a56da94132b743effc2d505ca0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:45.121594 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78e584a56da94132b743effc2d505ca0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:45.132035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78e584a56da94132b743effc2d505ca0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:45.132771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78e584a56da94132b743effc2d505ca0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:45.136220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:45.143015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f8944505-6cab-431c-9d5e-48cddac66369 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78e584a56da94132b743effc2d505ca0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:45.150246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1221/2453] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:44 2022] DELETE /identity/v3/users/78e584a56da94132b743effc2d505ca0 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:45.154848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:45.155196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:45.156240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:45.174856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:45.176779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:45.179410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:45.180858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:45.189546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1233/2454] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:45.266689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1222/2455] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:45.276213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:45.277884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:45.378958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8596e46-ef6c-440e-9f31-d3875565e0d3 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:45.444489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a80d1-ad93-4abf-ab6f-69a1e307e7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:45.445198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a80d1-ad93-4abf-ab6f-69a1e307e7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:45.445481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a80d1-ad93-4abf-ab6f-69a1e307e7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:45.446197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a80d1-ad93-4abf-ab6f-69a1e307e7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:45.459836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a80d1-ad93-4abf-ab6f-69a1e307e7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:45.461621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a80d1-ad93-4abf-ab6f-69a1e307e7f6 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:45.477682 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1234/2456] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:46.172809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.175201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:46.215570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ed23d-369f-4be1-9977-ba116c62032f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.222939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.224111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.224354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.224648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] PATH_INFO: `/v3/projects/760e7b86c9dd4010a6ab9c064d81a047` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.226314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=760e7b86c9dd4010a6ab9c064d81a047)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.228771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.289095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:46.298366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760e7b86c9dd4010a6ab9c064d81a047', 'request_id': 'req-58141234-4f3a-4260-8900-ae5b4fc7b89e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:46.306071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760e7b86c9dd4010a6ab9c064d81a047', 'request_id': 'req-58141234-4f3a-4260-8900-ae5b4fc7b89e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:46.315572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760e7b86c9dd4010a6ab9c064d81a047', 'request_id': 'req-58141234-4f3a-4260-8900-ae5b4fc7b89e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:46.333167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] The token cache is being invalidate because project 760e7b86c9dd4010a6ab9c064d81a047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:46.333759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:46.334716 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-58141234-4f3a-4260-8900-ae5b4fc7b89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:46.336641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1223/2457] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:46 2022] DELETE /identity/v3/projects/760e7b86c9dd4010a6ab9c064d81a047 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:46.344180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.345837 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.346633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.375178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:46.376707 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:46.544564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1235/2458] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:46.554117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.554445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.554750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.579227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:46.580460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:46.588608 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1224/2459] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:46.592790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.602938 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba37a9-c436-451e-a46e-b5cd82215a6f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.607597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.608281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.608591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.608863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.609807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:46.610117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.611897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.625327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1236/2460] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:46.629744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.639652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a235d-c953-4abc-ad52-c05f2e2477c5 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.644847 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.645587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.645936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.646273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.647130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.649091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.678868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1225/2461] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:46 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:46.680112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.691055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7279368e-37c0-4159-8f31-f94dd52e48ed admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.709955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:46.754238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.754956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.755241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.755515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.756201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.758135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.785599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1237/2462] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:46 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:46.789680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.800907 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b1853-7469-457b-a167-7b3502f7bf40 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.805795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.806488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.806790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.807056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.807803 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.809590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.822873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1226/2463] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:46.827257 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.838409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb12839-59f5-4479-9cd0-d1df158840e4 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.843723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e3f0a-5e27-422b-9aad-6d12e9a30678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.844412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3f0a-5e27-422b-9aad-6d12e9a30678 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.844731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3f0a-5e27-422b-9aad-6d12e9a30678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.845031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e3f0a-5e27-422b-9aad-6d12e9a30678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.845766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e3f0a-5e27-422b-9aad-6d12e9a30678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.847459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e3f0a-5e27-422b-9aad-6d12e9a30678 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.858444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1238/2464] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:46.862819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:46.881938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b781663-14a9-4410-9514-8a2e0c4fa48d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:46.887600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:46.888817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.889099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.889375 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] PATH_INFO: `/v3/projects/50c8c1abfd5042479d37b7fd39b28bdf/users/5dc44e84fa6847ecb1a4e2257840ef40/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.908087 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50c8c1abfd5042479d37b7fd39b28bdf, user_id=5dc44e84fa6847ecb1a4e2257840ef40, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:46.910888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:46.927406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1227/2465] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:46 2022] PUT /identity/v3/projects/50c8c1abfd5042479d37b7fd39b28bdf/users/5dc44e84fa6847ecb1a4e2257840ef40/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:46.937890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:46.938191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:46.938479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:46.971926 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] MFA Rules not processed for user `5dc44e84fa6847ecb1a4e2257840ef40`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:46.973160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:47.041464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1239/2466] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:47.053876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:47.055740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:47.141089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c931357-550b-4438-a36b-5cff2929ed3d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:47.145033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840d5e7-14ae-491a-a371-68202c4ae0be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:47.145698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d5e7-14ae-491a-a371-68202c4ae0be service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:47.146009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d5e7-14ae-491a-a371-68202c4ae0be service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:47.146285 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840d5e7-14ae-491a-a371-68202c4ae0be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:47.162317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840d5e7-14ae-491a-a371-68202c4ae0be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:47.163891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0840d5e7-14ae-491a-a371-68202c4ae0be service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:47.174860 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1228/2467] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:47.767936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:47.769471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:47.877199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9982b2a9-40e6-403e-9c88-8f5a4312e9a3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:47.883227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:47.884313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:47.884680 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:47.884873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] PATH_INFO: `/v3/users/d9740f5204964e7eb45a7951a8ca0c69` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:47.886259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9740f5204964e7eb45a7951a8ca0c69)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:47.888817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:47.935271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:47.965371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9740f5204964e7eb45a7951a8ca0c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:47.980429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9740f5204964e7eb45a7951a8ca0c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:47.991717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9740f5204964e7eb45a7951a8ca0c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.000414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9740f5204964e7eb45a7951a8ca0c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.001141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9740f5204964e7eb45a7951a8ca0c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.008444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1240/2468] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:47 2022] DELETE /identity/v3/users/d9740f5204964e7eb45a7951a8ca0c69 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:48.013488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:48.013919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:48.013919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:48.037253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:48.038815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:48.151590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1229/2469] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:48.166688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:48.168190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:48.266069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ff32dd-a7ef-4f79-a030-54348adab99d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:48.269757 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:48.270459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:48.270748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:48.271030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:48.281021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:48.282572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:48.292759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1241/2470] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:48.699894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:48.701643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:48.715367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a43bd2-d3ba-4706-8470-cdf03a7e2248 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:48.722141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:48.723145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:48.723441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:48.726744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] PATH_INFO: `/v3/projects/17afd5240ad542198e38e892f75176ba` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:48.728402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17afd5240ad542198e38e892f75176ba)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:48.730675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:48.732682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:48.798522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17afd5240ad542198e38e892f75176ba', 'request_id': 'req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.805430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17afd5240ad542198e38e892f75176ba', 'request_id': 'req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.814629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17afd5240ad542198e38e892f75176ba', 'request_id': 'req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.826683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] The token cache is being invalidate because project 17afd5240ad542198e38e892f75176ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:48.826973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.828162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.829734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1230/2471] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:48 2022] DELETE /identity/v3/projects/17afd5240ad542198e38e892f75176ba => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:48.833906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:48.845711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197eb6f5-d900-4f1a-93e8-02304dd4d65c service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:48.913300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:48.914229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:48.914550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:48.914826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] PATH_INFO: `/v3/users/f831c86a15d54127abf4b91ad3cbd2d2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:48.916219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f831c86a15d54127abf4b91ad3cbd2d2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:48.918209 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:48.970783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f831c86a15d54127abf4b91ad3cbd2d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.975503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:48.986208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f831c86a15d54127abf4b91ad3cbd2d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:48.995643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f831c86a15d54127abf4b91ad3cbd2d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.003599 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f831c86a15d54127abf4b91ad3cbd2d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.004317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f831c86a15d54127abf4b91ad3cbd2d2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.010779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1242/2472] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:48 2022] DELETE /identity/v3/users/f831c86a15d54127abf4b91ad3cbd2d2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:49.303924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:49.306391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:49.322030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086c112-0bcd-4bf8-9f04-0ddd6c4d8c85 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:49.406011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:49.407171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:49.407462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:49.407738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] PATH_INFO: `/v3/projects/dd419160c32c428fbe6aa1dbc3ff85f9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:49.409043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd419160c32c428fbe6aa1dbc3ff85f9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:49.411149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:49.461101 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd419160c32c428fbe6aa1dbc3ff85f9', 'request_id': 'req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.468783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd419160c32c428fbe6aa1dbc3ff85f9', 'request_id': 'req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.477532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd419160c32c428fbe6aa1dbc3ff85f9', 'request_id': 'req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.488900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] The token cache is being invalidate because project dd419160c32c428fbe6aa1dbc3ff85f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:49.489270 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.489890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.491539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1231/2473] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:49 2022] DELETE /identity/v3/projects/dd419160c32c428fbe6aa1dbc3ff85f9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:49.495568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:49.497052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:49.511234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30def9-2cf1-48c0-a91a-4d099ab1f4b7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:49.575617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:49.576412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:49.576700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:49.576957 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] PATH_INFO: `/v3/users/afcd3ccfc04b46dba15a25c3ddcf4f91` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:49.578636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afcd3ccfc04b46dba15a25c3ddcf4f91)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:49.580643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:49.640498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afcd3ccfc04b46dba15a25c3ddcf4f91'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.652664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afcd3ccfc04b46dba15a25c3ddcf4f91'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.664043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afcd3ccfc04b46dba15a25c3ddcf4f91'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.674229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afcd3ccfc04b46dba15a25c3ddcf4f91'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.674229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8c50fd7c-6cc8-4165-93d4-379bd27c6ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afcd3ccfc04b46dba15a25c3ddcf4f91'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:49.679488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1243/2474] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:49 2022] DELETE /identity/v3/users/afcd3ccfc04b46dba15a25c3ddcf4f91 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:49.983380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:49.985204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:49.998668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a7e7d-80b0-4a3f-b80c-319505b0f78f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.018901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:50.069944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.070895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.071268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.071680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] PATH_INFO: `/v3/projects/d5ce0032835c4eaf8098cbe3c4deea65` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.072897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ce0032835c4eaf8098cbe3c4deea65)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.074905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.126580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ce0032835c4eaf8098cbe3c4deea65', 'request_id': 'req-3ff69126-c5ff-46a0-ae97-f9a451b1a388'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:50.133660 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ce0032835c4eaf8098cbe3c4deea65', 'request_id': 'req-3ff69126-c5ff-46a0-ae97-f9a451b1a388'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:50.145426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ce0032835c4eaf8098cbe3c4deea65', 'request_id': 'req-3ff69126-c5ff-46a0-ae97-f9a451b1a388'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:50.157635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] The token cache is being invalidate because project d5ce0032835c4eaf8098cbe3c4deea65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:50.157917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:50.158597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3ff69126-c5ff-46a0-ae97-f9a451b1a388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:50.160198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1232/2475] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:49 2022] DELETE /identity/v3/projects/d5ce0032835c4eaf8098cbe3c4deea65 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:50.166597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.167128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.167211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.188758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:50.189998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:50.242310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:50.264832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1244/2476] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:50.275063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.275361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.275650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.296376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:50.297678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:50.306364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1233/2477] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:50.310852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.322359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520b95-cb88-4cac-8566-6aeced4e028f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.328778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.329448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.329727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.330010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.330763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:50.331077 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.332701 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.347994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1245/2478] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:50.352423 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.362237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362361c-3286-43c1-99a9-634aa72ee035 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.367220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.367901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.368204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.368485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.369176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.371207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.401855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1234/2479] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:50.406488 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.417582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ace54-7cf9-497b-b828-56a6b8a2768a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.481114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.481789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.482073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.482375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.483089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.485038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.511322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1246/2480] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:50.516862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.528705 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515093b3-1f6d-4f61-85d9-62ec57b82c37 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.540220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.540951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.541233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.541508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.542257 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.543936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.557135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1235/2481] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:50.561583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.572507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804706d3-c030-4d01-aa7b-a66152028b98 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.577661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa954727-c88a-46b0-90f4-0a5f057668a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.578482 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954727-c88a-46b0-90f4-0a5f057668a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.578819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954727-c88a-46b0-90f4-0a5f057668a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.579165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa954727-c88a-46b0-90f4-0a5f057668a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.579987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa954727-c88a-46b0-90f4-0a5f057668a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.581692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa954727-c88a-46b0-90f4-0a5f057668a2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.592693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1247/2482] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:50.598541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.608952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f394217-3ab0-4ebb-97b7-93cacaaf5eca admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.613600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.614562 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.614843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.615114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] PATH_INFO: `/v3/projects/b562374c701a4a649fdd2eb2cb98c1ac/users/144051b5f5a44dc898f10f000f951f99/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.633949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b562374c701a4a649fdd2eb2cb98c1ac, user_id=144051b5f5a44dc898f10f000f951f99, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.636607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.654244 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1236/2483] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:50 2022] PUT /identity/v3/projects/b562374c701a4a649fdd2eb2cb98c1ac/users/144051b5f5a44dc898f10f000f951f99/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:50.666469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.666856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.667202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.704845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] MFA Rules not processed for user `144051b5f5a44dc898f10f000f951f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:50.706304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:50.784574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1248/2484] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:50.789389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.846083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:50.876703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dd0384-0a6e-42b6-972c-7015c36fb0e1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.886681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:50.887440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:50.888410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:50.888746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:50.889448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:50.893256 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:50.941258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1237/2485] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/projects => generated 381 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:50.945325 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.957538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aecf456-884c-49a5-8b77-61e99c31feec None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:50.988224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:50.989977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:51.010360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:51.026884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.027645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.027935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.028280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.029017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.031364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.053777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1249/2486] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:50 2022] POST /identity/v3/users => generated 297 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:51.056861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723ec44-1dac-4f85-ae2c-d1d080c8004d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.057501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:51.060883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.061550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.062588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.062923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.065024 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:51.068061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a672dc-56fc-4f80-9cfa-b4d286714173 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.072756 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.073624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.073911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.074188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.075215 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.078071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.079510 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.080930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.091731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1250/2487] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:51.091915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1238/2488] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:51.095420 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:51.106782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bf05c-47ec-4e95-b0da-56a7ad1d1b67 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.114778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.115722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.116129 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.116408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] PATH_INFO: `/v3/projects/cc52f358622c4117ab3e49a5dbb3fcf2/users/902ffea6732544968beef0779ea505e9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.140375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc52f358622c4117ab3e49a5dbb3fcf2, user_id=902ffea6732544968beef0779ea505e9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.143167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.162158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1251/2489] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:51 2022] PUT /identity/v3/projects/cc52f358622c4117ab3e49a5dbb3fcf2/users/902ffea6732544968beef0779ea505e9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:51.163210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:51.174373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173a413-6da9-4bb6-96bc-0ccdc07b32b1 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.243307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcc332f-59cd-4607-8b17-5cb20fc37c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.244524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc332f-59cd-4607-8b17-5cb20fc37c4e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.245081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc332f-59cd-4607-8b17-5cb20fc37c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.245478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcc332f-59cd-4607-8b17-5cb20fc37c4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.246348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc332f-59cd-4607-8b17-5cb20fc37c4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.248972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcc332f-59cd-4607-8b17-5cb20fc37c4e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.263301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1239/2490] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:51.268112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:51.279567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af0acc5-622c-4c1c-97a2-5f907a3bcd9b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.284956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.285868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.286150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.286448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] PATH_INFO: `/v3/projects/cc52f358622c4117ab3e49a5dbb3fcf2/users/902ffea6732544968beef0779ea505e9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.288585 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc52f358622c4117ab3e49a5dbb3fcf2, user_id=902ffea6732544968beef0779ea505e9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.291377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.303096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1252/2491] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:51 2022] PUT /identity/v3/projects/cc52f358622c4117ab3e49a5dbb3fcf2/users/902ffea6732544968beef0779ea505e9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:51.314297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.315129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.315434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.344146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] MFA Rules not processed for user `902ffea6732544968beef0779ea505e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:51.345938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:51.417153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:51.429446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1240/2492] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:51.441445 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:51.443783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:51.506484 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1a69c-bdc5-4eef-9cc2-fe26a0fb3e99 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.510226 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.510918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.511197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.511471 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.523189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.524718 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.536478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1253/2493] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:51.643023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:51.653237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eecb75a-b8c9-4ea1-925c-e3683783e481 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:51.657019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:51.657702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:51.657987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:51.658260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:51.721765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:51.723361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:51.733438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1241/2494] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:52.755212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:52.756815 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:52.832328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85cd89-79eb-4963-93c6-dd9cf078db09 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:52.836281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:52.837041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:52.837399 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:52.837664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:52.839716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:52.899013 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:52.921796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:52.923406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126627e-b9ee-449f-be6d-57c34c60e515 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:52.934859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1254/2495] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:54.458842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:54.604603 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0e6a5-756c-423a-a5b7-963a942d075e service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:54.634146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:54.635542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:54.635986 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:54.636442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] PATH_INFO: `/v3/users/144051b5f5a44dc898f10f000f951f99` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:54.638315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] RBAC: Authorizing `identity:delete_user(user_id=144051b5f5a44dc898f10f000f951f99)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:54.650205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:54.828086 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '144051b5f5a44dc898f10f000f951f99'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:54.878820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '144051b5f5a44dc898f10f000f951f99'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:54.890874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '144051b5f5a44dc898f10f000f951f99'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:54.891625 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '144051b5f5a44dc898f10f000f951f99'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:54.901970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '144051b5f5a44dc898f10f000f951f99'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:54.922901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1242/2496] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:54 2022] DELETE /identity/v3/users/144051b5f5a44dc898f10f000f951f99 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:54.927985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:54.928944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:54.929433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:54.950307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:54.951930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:55.036015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1255/2497] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:55.042658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:55.044629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:55.068940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:55.154929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ee0d7-5830-417a-b621-c0acf303518d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:55.164809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:55.165530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:55.165857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:55.166180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:55.177317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:55.179185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:55.191188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1243/2498] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:55.297245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:55.300786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:55.323850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559992e-9a91-4bd4-a171-45d1d4ee56aa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:55.344793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:55.346349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:55.353280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:55.353810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] PATH_INFO: `/v3/users/c5ef575152d54c92af80295e1f89603d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:55.356133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5ef575152d54c92af80295e1f89603d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:55.360942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:55.478730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5ef575152d54c92af80295e1f89603d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.501390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5ef575152d54c92af80295e1f89603d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.515983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5ef575152d54c92af80295e1f89603d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.525414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5ef575152d54c92af80295e1f89603d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.526546 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5ef575152d54c92af80295e1f89603d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.534474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1256/2499] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:55 2022] DELETE /identity/v3/users/c5ef575152d54c92af80295e1f89603d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:55.626648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:55.628268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:55.647345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134a8ba1-081f-4de4-b99f-0533af207513 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:55.723459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:55.724384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:55.724681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:55.724937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] PATH_INFO: `/v3/projects/b562374c701a4a649fdd2eb2cb98c1ac` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:55.726288 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b562374c701a4a649fdd2eb2cb98c1ac)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:55.728252 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:55.768350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:55.770114 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:55.789335 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f15b85-0c9a-461c-91c9-68c446135fe5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:55.795832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b562374c701a4a649fdd2eb2cb98c1ac', 'request_id': 'req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.803681 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b562374c701a4a649fdd2eb2cb98c1ac', 'request_id': 'req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.814653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b562374c701a4a649fdd2eb2cb98c1ac', 'request_id': 'req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.835352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] The token cache is being invalidate because project b562374c701a4a649fdd2eb2cb98c1ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:55.835675 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.836335 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.838092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1244/2500] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:55 2022] DELETE /identity/v3/projects/b562374c701a4a649fdd2eb2cb98c1ac => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:55.842850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:55.845111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:55.871015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:55.881760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:55.886587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:55.886587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:55.886587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] PATH_INFO: `/v3/projects/23a644f6b1e94809aa845fc61ed2b48f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:55.886587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a644f6b1e94809aa845fc61ed2b48f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:55.889346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:55.919717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:55.946254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8cf10-fb52-48ea-930f-5a9554ac43c1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:55.953435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a644f6b1e94809aa845fc61ed2b48f', 'request_id': 'req-ff08c5cc-b828-45cc-901b-f79c16f604e5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.962143 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a644f6b1e94809aa845fc61ed2b48f', 'request_id': 'req-ff08c5cc-b828-45cc-901b-f79c16f604e5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.973473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a644f6b1e94809aa845fc61ed2b48f', 'request_id': 'req-ff08c5cc-b828-45cc-901b-f79c16f604e5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.989295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] The token cache is being invalidate because project 23a644f6b1e94809aa845fc61ed2b48f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:55.989566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.990624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ff08c5cc-b828-45cc-901b-f79c16f604e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:55.992438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1257/2501] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:55 2022] DELETE /identity/v3/projects/23a644f6b1e94809aa845fc61ed2b48f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:55.997095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a7620-c6c9-4853-9241-1e8b49a4d462 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:55.997380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a7620-c6c9-4853-9241-1e8b49a4d462 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:55.997655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a7620-c6c9-4853-9241-1e8b49a4d462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.021102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bc0a7620-c6c9-4853-9241-1e8b49a4d462 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:56.021643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.022672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bc0a7620-c6c9-4853-9241-1e8b49a4d462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:56.022794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.022903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.023146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] PATH_INFO: `/v3/users/902ffea6732544968beef0779ea505e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.024710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=902ffea6732544968beef0779ea505e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.027094 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.042329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1258/2502] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:56.044204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.044664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.045175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.073583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:56.075618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:56.087652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1259/2503] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:56.093199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.117319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc40877-54a5-4fd1-abd1-21bbe7b1b5de None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.126181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902ffea6732544968beef0779ea505e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.140783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.141539 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.141982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.142319 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.143249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:56.143696 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.145291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.159212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902ffea6732544968beef0779ea505e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.175460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902ffea6732544968beef0779ea505e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.177582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902ffea6732544968beef0779ea505e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.182492 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1260/2504] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:04:56.185044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.187010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:56.191389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902ffea6732544968beef0779ea505e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.200529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1245/2505] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:55 2022] DELETE /identity/v3/users/902ffea6732544968beef0779ea505e9 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:56.201364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429d3f3-5070-4273-825c-98e182cf9472 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.288198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.289053 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.289411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.289920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.290731 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.294138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.337597 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1261/2506] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:56 2022] POST /identity/v3/projects => generated 367 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:56.338873 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.352168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9153a56-32a1-4dc4-83a8-cda0e0166c0b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.537422 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.539340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.539872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.540380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.541321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.544133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.585446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1246/2507] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:56 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:56.589265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.602122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f521e6-987a-4838-9ab3-308e5e77bc17 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.614659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.615369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.615654 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.615930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.616678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.621192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.634620 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1262/2508] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:56.638845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.646876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:56.656977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c1b9f-668e-45b9-a771-f5042300dd49 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.665217 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.666060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.666316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.667164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.667545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.669543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.683819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1247/2509] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:56.688615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.699798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d6e3e-4659-4470-9cd7-eda8dae1501b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.705244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8102da5-9fa8-443b-9405-1a240bb997c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.706150 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102da5-9fa8-443b-9405-1a240bb997c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.706458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102da5-9fa8-443b-9405-1a240bb997c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.706744 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8102da5-9fa8-443b-9405-1a240bb997c9 admin admin] PATH_INFO: `/v3/projects/3ae5050239b04805a0945b65254f441d/users/5419b9b1f26e4acca9b2b52648f346f4/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.729782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8102da5-9fa8-443b-9405-1a240bb997c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ae5050239b04805a0945b65254f441d, user_id=5419b9b1f26e4acca9b2b52648f346f4, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.733789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8102da5-9fa8-443b-9405-1a240bb997c9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.749498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.751396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:56.755390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1263/2510] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:56 2022] PUT /identity/v3/projects/3ae5050239b04805a0945b65254f441d/users/5419b9b1f26e4acca9b2b52648f346f4/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:56.767842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.768475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.769773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.784163 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf63531-1cf1-4009-80a9-9ff1374c24f1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:56.805403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:56.821440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] MFA Rules not processed for user `5419b9b1f26e4acca9b2b52648f346f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:56.823637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:56.898657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:56.899678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:56.899964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:56.900242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] PATH_INFO: `/v3/projects/cc52f358622c4117ab3e49a5dbb3fcf2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:56.901458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc52f358622c4117ab3e49a5dbb3fcf2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:56.903612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:56.908656 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1264/2511] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:56.919965 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:56.922251 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:56.976807 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc52f358622c4117ab3e49a5dbb3fcf2', 'request_id': 'req-6fcca636-efad-498f-a15e-016d3b9ed39f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.985750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc52f358622c4117ab3e49a5dbb3fcf2', 'request_id': 'req-6fcca636-efad-498f-a15e-016d3b9ed39f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:56.999549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc52f358622c4117ab3e49a5dbb3fcf2', 'request_id': 'req-6fcca636-efad-498f-a15e-016d3b9ed39f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:57.000281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1cefd-51c7-4691-9050-fab186e3fe52 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.024905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] The token cache is being invalidate because project cc52f358622c4117ab3e49a5dbb3fcf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:04:57.025246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:57.027199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6fcca636-efad-498f-a15e-016d3b9ed39f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:57.029227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1248/2512] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:04:56 2022] DELETE /identity/v3/projects/cc52f358622c4117ab3e49a5dbb3fcf2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:04:57.034254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2796da-fc38-4a14-9b5c-4e8d1a2c5514 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.034609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2796da-fc38-4a14-9b5c-4e8d1a2c5514 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.034890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2796da-fc38-4a14-9b5c-4e8d1a2c5514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.066964 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5a2796da-fc38-4a14-9b5c-4e8d1a2c5514 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:57.071272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5a2796da-fc38-4a14-9b5c-4e8d1a2c5514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:57.081960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.082666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.082951 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.083373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.085787 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:57.160952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.161791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1249/2513] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:04:57.162510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.170390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.170902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.171182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.172575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1265/2514] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:57.190218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:57.191487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:57.199492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1250/2515] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:57.204064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.215604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42db9bca-02b4-47a1-937d-29db14b16bc2 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.222043 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.222870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.223264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.223584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.224552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:04:57.224884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.226746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.229723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:57.243308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1266/2516] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 10:04:57.247991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.258952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d650c8-8a42-4971-9a6f-75de6cfe202f None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.265121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.265792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.266070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.266339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.267072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.269158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.284213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:57.309944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1251/2517] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/projects => generated 387 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:57.314349 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.325918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27133f2-3a76-438b-a486-c159651df16c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.423988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.425543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.425828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.426108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.428434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.431260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.468054 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1267/2518] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:57.474464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.490896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd43fc-d7d2-4c25-bbcf-2f77a5071eb9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.499543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.500452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.500785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.501989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.502844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.505058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.539635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1252/2519] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:57.541354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.559569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050f4b3-a9ff-4e8d-8fd3-7db37720c340 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.579812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71446c-17c4-4445-80ac-eea1bd5d609d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.582300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71446c-17c4-4445-80ac-eea1bd5d609d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.583002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71446c-17c4-4445-80ac-eea1bd5d609d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.583159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71446c-17c4-4445-80ac-eea1bd5d609d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.583861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71446c-17c4-4445-80ac-eea1bd5d609d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.585520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71446c-17c4-4445-80ac-eea1bd5d609d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.599111 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1268/2520] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:57.604068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.616544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe18a80-3d19-4c9b-b99d-1bff0e1248b3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.623819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.625203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.625792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.626226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] PATH_INFO: `/v3/projects/fa682c90dbce451783a39904af44c077/users/11fd2d71550642db84ebfada54710d97/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.651737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa682c90dbce451783a39904af44c077, user_id=11fd2d71550642db84ebfada54710d97, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.655245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.675259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1253/2521] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:57 2022] PUT /identity/v3/projects/fa682c90dbce451783a39904af44c077/users/11fd2d71550642db84ebfada54710d97/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:57.744571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.744862 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.745179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.772466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] MFA Rules not processed for user `11fd2d71550642db84ebfada54710d97`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:57.773708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:57.858968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1269/2522] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:57.864223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:57.940961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff008b5-eecc-4aae-86af-fcef8cbb24de admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:57.948610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:57.949342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:57.949667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:57.949935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:57.950754 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:57.953307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:57.993063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1254/2523] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:04:57.994813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:58.006998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2f49a-51d7-4b18-81d8-539267dac97b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:58.074700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:58.075326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.075603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.075870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.076566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:58.078638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:58.088069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:58.103014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1270/2524] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:04:57 2022] POST /identity/v3/users => generated 299 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:04:58.107274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:58.118081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635fdda-da9a-47da-af6a-551e830d681e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:58.123022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:58.123711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.124026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.124312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.125120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:58.126905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:58.140537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1255/2525] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:04:58.145045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:58.159630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3ba0f-b353-44ad-a94c-8439233c5088 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:58.161658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:58.162633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.162919 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.163196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] PATH_INFO: `/v3/projects/f14edf3c53da4bd2b52ebebaa8cb32f0/users/c125b410caef4785a79cc95a1aadb3e9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.179904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14edf3c53da4bd2b52ebebaa8cb32f0, user_id=c125b410caef4785a79cc95a1aadb3e9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:58.182626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:58.198085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1271/2526] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:58 2022] PUT /identity/v3/projects/f14edf3c53da4bd2b52ebebaa8cb32f0/users/c125b410caef4785a79cc95a1aadb3e9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:58.202409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:58.213123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66a542f-bdba-42ea-8990-83683c7d5a8e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:58.277916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a88fe3-a2ba-4af8-b9b6-289498a74ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:58.278643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a88fe3-a2ba-4af8-b9b6-289498a74ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.279096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a88fe3-a2ba-4af8-b9b6-289498a74ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.279589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a88fe3-a2ba-4af8-b9b6-289498a74ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.281027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a88fe3-a2ba-4af8-b9b6-289498a74ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:58.283962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a88fe3-a2ba-4af8-b9b6-289498a74ca9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:58.295458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1256/2527] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:04:58.299981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:58.310997 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da474ea-5d61-4c92-b469-d7968127590a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:58.315814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:58.316741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.316995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.317287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] PATH_INFO: `/v3/projects/f14edf3c53da4bd2b52ebebaa8cb32f0/users/c125b410caef4785a79cc95a1aadb3e9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.319236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f14edf3c53da4bd2b52ebebaa8cb32f0, user_id=c125b410caef4785a79cc95a1aadb3e9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:58.321840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:58.334259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1272/2528] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:04:58 2022] PUT /identity/v3/projects/f14edf3c53da4bd2b52ebebaa8cb32f0/users/c125b410caef4785a79cc95a1aadb3e9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:58.345119 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.345289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.345566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.379631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] MFA Rules not processed for user `c125b410caef4785a79cc95a1aadb3e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:58.380853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:58.398765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:58.457191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1257/2529] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:58.469126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:58.471068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:58.534770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5bf675-cadf-4792-9c44-972c8e1f734f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:58.538888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:58.539575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:58.539860 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:58.540121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:58.550829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:58.552394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:58.564636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1273/2530] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:59.013332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:59.015441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.115157 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6ded8-ffc3-4b7b-b1e2-0341645e1229 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:59.121012 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:59.122051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.122737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.123290 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:59.132895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.217879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:59.219320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cce869-5501-4f82-97df-844226281dd5 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:59.230877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1258/2531] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:04:59.269645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:59.280945 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1024aa38-9554-48e6-a4e6-36a356c2f6a8 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:59.285876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:59.287518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.289292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.289741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] PATH_INFO: `/v3/users/11fd2d71550642db84ebfada54710d97` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:59.291038 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fd2d71550642db84ebfada54710d97)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:59.293029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:59.382069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fd2d71550642db84ebfada54710d97'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.397948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fd2d71550642db84ebfada54710d97'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.409176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fd2d71550642db84ebfada54710d97'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.417653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fd2d71550642db84ebfada54710d97'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.418181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fd2d71550642db84ebfada54710d97'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.425347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1274/2532] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:59 2022] DELETE /identity/v3/users/11fd2d71550642db84ebfada54710d97 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:59.430747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.431084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.431373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:59.453720 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:59.455183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.536559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1259/2533] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:59.547314 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:59.549181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.604706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:59.648583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc342e8-6d33-46c0-b5be-1106822edb74 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:59.654121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c9e42-677d-4082-97bf-605aec922865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:59.654826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9e42-677d-4082-97bf-605aec922865 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.655170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9e42-677d-4082-97bf-605aec922865 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.655476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c9e42-677d-4082-97bf-605aec922865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:59.667454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c9e42-677d-4082-97bf-605aec922865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:59.669297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9c9e42-677d-4082-97bf-605aec922865 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:59.683344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:59.684231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1275/2534] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:04:59.693386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.702502 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:04:59.707006 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a24137-e135-4f31-900d-cdf3a27f9e9e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:59.715440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:59.716465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.716844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.717210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] PATH_INFO: `/v3/users/bb270a21607f403f8e003732423dfbee` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:59.719186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb270a21607f403f8e003732423dfbee)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:04:59.721188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:04:59.776789 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb270a21607f403f8e003732423dfbee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.792912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb270a21607f403f8e003732423dfbee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.803445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb270a21607f403f8e003732423dfbee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.804196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb270a21607f403f8e003732423dfbee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.813540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb270a21607f403f8e003732423dfbee'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:04:59.820868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1260/2535] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:04:59 2022] DELETE /identity/v3/users/bb270a21607f403f8e003732423dfbee => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:04:59.825180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.825463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.825738 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:04:59.847056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:04:59.847500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.913435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1276/2536] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:04:59.923410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:04:59.924938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:04:59.992931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf54ed1-5283-41d5-bc8c-7a1f62cad8a7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:04:59.996962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:04:59.997631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:04:59.997932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:04:59.998607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:00.009692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:00.011260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:00.021859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1261/2537] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:04:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:00.121855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:00.123205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:00.137388 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25c79f-93eb-4933-af5d-cff9e1fd3659 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:00.143291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:00.144655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:00.144959 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:00.145354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] PATH_INFO: `/v3/projects/fa682c90dbce451783a39904af44c077` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:00.147158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa682c90dbce451783a39904af44c077)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:00.149378 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:00.267128 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa682c90dbce451783a39904af44c077', 'request_id': 'req-46c0afbb-b0b6-4097-9552-ac790a894c58'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.277082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa682c90dbce451783a39904af44c077', 'request_id': 'req-46c0afbb-b0b6-4097-9552-ac790a894c58'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.288035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa682c90dbce451783a39904af44c077', 'request_id': 'req-46c0afbb-b0b6-4097-9552-ac790a894c58'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.301523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] The token cache is being invalidate because project fa682c90dbce451783a39904af44c077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:00.302065 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.303273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.305277 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1277/2538] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:00 2022] DELETE /identity/v3/projects/fa682c90dbce451783a39904af44c077 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:00.309678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:00.323881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92cfcf-4673-4dcd-b997-e0bc5ca1655d service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:00.423447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:00.426805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:00.426805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:00.426805 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] PATH_INFO: `/v3/users/c125b410caef4785a79cc95a1aadb3e9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:00.428195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:00.429847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:00.430170 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c125b410caef4785a79cc95a1aadb3e9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:00.434191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:00.474624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0afbb-b0b6-4097-9552-ac790a894c58 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:00.485474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:00.487344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:00.487915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:00.488423 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:00.488841 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] PATH_INFO: `/v3/projects/ef8a56f8e62143b686935e4229c2c450` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:00.490569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8a56f8e62143b686935e4229c2c450)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:00.495589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:00.549799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c125b410caef4785a79cc95a1aadb3e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.573317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c125b410caef4785a79cc95a1aadb3e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.585286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8a56f8e62143b686935e4229c2c450', 'request_id': 'req-3e3537a1-96ff-416a-8187-fa09eb6def90'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.588223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:00.595502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8a56f8e62143b686935e4229c2c450', 'request_id': 'req-3e3537a1-96ff-416a-8187-fa09eb6def90'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.596367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c125b410caef4785a79cc95a1aadb3e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.597983 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c125b410caef4785a79cc95a1aadb3e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.606001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c125b410caef4785a79cc95a1aadb3e9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.609765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8a56f8e62143b686935e4229c2c450', 'request_id': 'req-3e3537a1-96ff-416a-8187-fa09eb6def90'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.617115 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1262/2539] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:00 2022] DELETE /identity/v3/users/c125b410caef4785a79cc95a1aadb3e9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:00.644653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] The token cache is being invalidate because project ef8a56f8e62143b686935e4229c2c450 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:00.644953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.647164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.650589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1278/2540] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:00 2022] DELETE /identity/v3/projects/ef8a56f8e62143b686935e4229c2c450 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:00.655058 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:00.656392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:00.819283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55661e0e-f9f5-4617-ab0a-e0cd4d9e407a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:00.825746 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:00.827034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:00.827409 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:00.827786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] PATH_INFO: `/v3/users/e209be3d5d2e4be4aeac7aa1d3f54966` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:00.829148 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e209be3d5d2e4be4aeac7aa1d3f54966)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:00.831250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:00.893397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e209be3d5d2e4be4aeac7aa1d3f54966'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.912435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e209be3d5d2e4be4aeac7aa1d3f54966'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.923055 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e209be3d5d2e4be4aeac7aa1d3f54966'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.923706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e209be3d5d2e4be4aeac7aa1d3f54966'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.931521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-446eacea-7abe-449e-818b-d21b228317e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e209be3d5d2e4be4aeac7aa1d3f54966'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:00.938521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1263/2541] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:00 2022] DELETE /identity/v3/users/e209be3d5d2e4be4aeac7aa1d3f54966 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:00.989382 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:00.991705 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.096145 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3537a1-96ff-416a-8187-fa09eb6def90 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.194567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.196268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.197002 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.197497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] PATH_INFO: `/v3/projects/f14edf3c53da4bd2b52ebebaa8cb32f0` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.200076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f14edf3c53da4bd2b52ebebaa8cb32f0)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.202518 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.278099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f14edf3c53da4bd2b52ebebaa8cb32f0', 'request_id': 'req-bc2cc960-05e7-448c-9aa1-483d02b2eda2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.288834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f14edf3c53da4bd2b52ebebaa8cb32f0', 'request_id': 'req-bc2cc960-05e7-448c-9aa1-483d02b2eda2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.302877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f14edf3c53da4bd2b52ebebaa8cb32f0', 'request_id': 'req-bc2cc960-05e7-448c-9aa1-483d02b2eda2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.328085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] The token cache is being invalidate because project f14edf3c53da4bd2b52ebebaa8cb32f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:01.328085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.329036 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.331783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1279/2542] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:00 2022] DELETE /identity/v3/projects/f14edf3c53da4bd2b52ebebaa8cb32f0 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:01.338019 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e9bf-9702-4bad-92d1-8dd2677e4eb3 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.338619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e9bf-9702-4bad-92d1-8dd2677e4eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.339020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532e9bf-9702-4bad-92d1-8dd2677e4eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.356771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.359418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.389438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0532e9bf-9702-4bad-92d1-8dd2677e4eb3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:01.398240 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0532e9bf-9702-4bad-92d1-8dd2677e4eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.402396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:01.434243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:01.475286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cc960-05e7-448c-9aa1-483d02b2eda2 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.485476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.486361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.486690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.486967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] PATH_INFO: `/v3/projects/ae38eb6c782e440ca0095cb47c46d88d` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.488627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae38eb6c782e440ca0095cb47c46d88d)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.490600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.513303 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1264/2543] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:01.521823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.522382 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.523272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.544202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:01.545575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.561328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1265/2544] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:01.566262 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.579653 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605945e-535a-4cad-8a82-ae3a99115989 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.581900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae38eb6c782e440ca0095cb47c46d88d', 'request_id': 'req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.588889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae38eb6c782e440ca0095cb47c46d88d', 'request_id': 'req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.601765 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae38eb6c782e440ca0095cb47c46d88d', 'request_id': 'req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.619394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] The token cache is being invalidate because project ae38eb6c782e440ca0095cb47c46d88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:01.619693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.620789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c38c4a26-f02b-49e4-8d3e-2c67afdcf664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:01.626533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1280/2545] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:01 2022] DELETE /identity/v3/projects/ae38eb6c782e440ca0095cb47c46d88d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:01.630157 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a226-df10-4719-bf92-257249f37e07 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.630477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a226-df10-4719-bf92-257249f37e07 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.630760 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4a226-df10-4719-bf92-257249f37e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.661184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3de4a226-df10-4719-bf92-257249f37e07 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:01.661427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.662059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.662392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.662749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.663272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3de4a226-df10-4719-bf92-257249f37e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.663482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:01.663788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.665861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.682046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1281/2546] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:01.684516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.684820 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.685219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1266/2547] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:01.685337 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.690593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.694065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.719085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:01.720016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9881996-85b1-488a-9fb7-3385365447bd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.720308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:01.725151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.725982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.726462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.726911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.728022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.728193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1282/2548] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:01.730392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.733619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.746336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967bc4-d688-4c6a-9cb8-fdae3c3850ea None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.757763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.758582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.758805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.759096 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.760727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:01.760727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.762373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.786567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1283/2549] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:01.788293 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.797692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1267/2550] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:01.798797 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.805066 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af90fa90-8945-4a35-8085-06f72fc8dc01 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.918551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.919364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.919745 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.920118 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.922570 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.925332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.941231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca9e02c-8cec-46a3-9f86-26e0955a9f6b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:01.947507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:01.948520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:01.949018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:01.949504 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:01.950959 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:01.953633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:01.966377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1284/2551] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/projects => generated 399 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:01.968164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:01.978732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:01.986300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1268/2552] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/users => generated 288 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:01.990753 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.003422 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d90c22-6102-426c-aa95-afd397227f8d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.016231 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:02.049353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51f31f-873e-4a79-b333-5f41690dfd7b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.055055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.055824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.056245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.056534 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.057238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.059359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.087618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1285/2553] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:01 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:02.092102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.097493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.098764 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.099401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.099880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.100899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.103648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.104327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c6d66-762d-4d82-a5ab-d2d27197ff7d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.112616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.113622 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.113889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.114182 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.115081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.116666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.124440 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1269/2554] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:02.134186 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1286/2555] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:02.134384 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.135290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.145167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb8021-2142-4974-bdc9-a281865efae6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.146199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05943054-6468-402a-9e30-1593a3676b0a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.150742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.151513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.151785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.152183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.152323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.152548 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.152725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.152875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.153786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.154003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.155900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.156100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.176323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1287/2556] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:02.176323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.176643 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1270/2557] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:02.177552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.195054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e27d54-9c31-4698-b321-61530ecca1bb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.195892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9bf8-8749-42b0-8636-b3f4150727b1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.200091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd9306-d64a-4524-b04f-584996de2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.201089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9306-d64a-4524-b04f-584996de2698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.201467 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9306-d64a-4524-b04f-584996de2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.201886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd9306-d64a-4524-b04f-584996de2698 admin admin] PATH_INFO: `/v3/projects/1e8720c7b87c4ff0acffdd08adeb371d/users/a545ad292abd4a04abb5ccf43c74350b/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.202589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eef66-141b-412c-90a4-cdd26b30df5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.203692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eef66-141b-412c-90a4-cdd26b30df5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.204136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eef66-141b-412c-90a4-cdd26b30df5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.204564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eef66-141b-412c-90a4-cdd26b30df5a admin admin] PATH_INFO: `/v3/projects/c684b5611052444facb0382acd563068/users/eae472f14246421db063f6ce415f9a85/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.221655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd9306-d64a-4524-b04f-584996de2698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e8720c7b87c4ff0acffdd08adeb371d, user_id=a545ad292abd4a04abb5ccf43c74350b, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.225488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd9306-d64a-4524-b04f-584996de2698 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.251411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1271/2558] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:02 2022] PUT /identity/v3/projects/1e8720c7b87c4ff0acffdd08adeb371d/users/a545ad292abd4a04abb5ccf43c74350b/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:02.268801 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.269088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.269426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.304276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] MFA Rules not processed for user `a545ad292abd4a04abb5ccf43c74350b`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:02.306007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:02.404711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1272/2559] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:02.408799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.429138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eef66-141b-412c-90a4-cdd26b30df5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c684b5611052444facb0382acd563068, user_id=eae472f14246421db063f6ce415f9a85, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.432217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4eef66-141b-412c-90a4-cdd26b30df5a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.454664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1288/2560] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:02 2022] PUT /identity/v3/projects/c684b5611052444facb0382acd563068/users/eae472f14246421db063f6ce415f9a85/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:02.469904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c58f4-dee8-4585-beee-54896396a611 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.471232 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c58f4-dee8-4585-beee-54896396a611 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.471677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430c58f4-dee8-4585-beee-54896396a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.522621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-430c58f4-dee8-4585-beee-54896396a611 None None] MFA Rules not processed for user `eae472f14246421db063f6ce415f9a85`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:02.523997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1c6fa-9d76-4366-9cbf-cfd51ef3f0c7 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.524171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-430c58f4-dee8-4585-beee-54896396a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:02.533479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:02.631634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.633700 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.634080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.634555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.636070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.641977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.672591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1289/2561] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:02.682090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c58f4-dee8-4585-beee-54896396a611 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.694598 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430c58f4-dee8-4585-beee-54896396a611 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.700460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1273/2562] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:02 2022] POST /identity/v3/projects => generated 401 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:02.700963 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.701782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.702201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.702577 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.703613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.706897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.709611 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.776203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1290/2563] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:02 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:02.780842 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.808842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6348f978-73b2-4e79-92e7-2804b7f62c86 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.828781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:02.920468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.921473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.921851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.922136 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.922880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.925108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.936759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727aa454-1b5a-4b50-9f5e-dddbdd6bf40c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.945931 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.946940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.947402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.947655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.948646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.950675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.960613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1274/2564] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:02 2022] POST /identity/v3/users => generated 307 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:02.964967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.980275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8223bcd2-8d9d-4fc4-94b6-05959748eae0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:02.986008 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1291/2565] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:02 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:02.987016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:02.989193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:02.990123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:02.990531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:02.991002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:02.992196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:02.994829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:02.999425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8b3b59-02a8-4e66-8750-d91df112719e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.005393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.006201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.006590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.006973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.007778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.009503 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.015490 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1275/2566] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:03.025038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.028200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1292/2567] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:03.031925 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d5018-5e6d-4652-b1ed-4a9fce235d24 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.032971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.037164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.038250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.038848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.039424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] PATH_INFO: `/v3/projects/02bc5aa90be8449dabea58941bbfa9c5/users/9a44f933d2c0424b985de55bbe9acae6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.046131 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea976f8c-5a71-43b8-a67f-54501f6d5d34 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.049873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.051024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.051311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.052109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] PATH_INFO: `/v3/projects/77b87641a5134d55903c6ea1be3617f4/users/b904d3176a1142d99feef26f39348854/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.060039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bc5aa90be8449dabea58941bbfa9c5, user_id=9a44f933d2c0424b985de55bbe9acae6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.063049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.069494 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b87641a5134d55903c6ea1be3617f4, user_id=b904d3176a1142d99feef26f39348854, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.072260 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.075365 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:03.090185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1276/2568] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:03 2022] PUT /identity/v3/projects/02bc5aa90be8449dabea58941bbfa9c5/users/9a44f933d2c0424b985de55bbe9acae6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:03.091659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.097344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1293/2569] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:03 2022] PUT /identity/v3/projects/77b87641a5134d55903c6ea1be3617f4/users/b904d3176a1142d99feef26f39348854/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:03.101342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.211803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b0ca8-bf8d-4403-accc-b8e681adc2c5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.217952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.218297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.218613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.219133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.220095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.222078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.233942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d2fc80-48fc-4312-98c0-b3e75abcb343 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.239711 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.240464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.240756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.241032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.243806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1294/2570] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:03.244082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.244082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.246064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.260416 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1277/2571] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:03 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:03.261353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.262437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10419957-cccf-4344-9d5e-ce18f6940375 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.269304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e38b5-c9c2-43a8-a45e-77586fc18364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.270797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e38b5-c9c2-43a8-a45e-77586fc18364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.271235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e38b5-c9c2-43a8-a45e-77586fc18364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.271840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e38b5-c9c2-43a8-a45e-77586fc18364 admin admin] PATH_INFO: `/v3/projects/77b87641a5134d55903c6ea1be3617f4/users/b904d3176a1142d99feef26f39348854/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.274499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6301ef-4b30-472e-a15b-711cdac66f9a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.274888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e38b5-c9c2-43a8-a45e-77586fc18364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77b87641a5134d55903c6ea1be3617f4, user_id=b904d3176a1142d99feef26f39348854, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.278316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e38b5-c9c2-43a8-a45e-77586fc18364 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.281823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbc3d7-57c7-45ec-968e-7b75512a59e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.282811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc3d7-57c7-45ec-968e-7b75512a59e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.283099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc3d7-57c7-45ec-968e-7b75512a59e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.283377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbc3d7-57c7-45ec-968e-7b75512a59e9 admin admin] PATH_INFO: `/v3/projects/02bc5aa90be8449dabea58941bbfa9c5/users/9a44f933d2c0424b985de55bbe9acae6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.285747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbc3d7-57c7-45ec-968e-7b75512a59e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bc5aa90be8449dabea58941bbfa9c5, user_id=9a44f933d2c0424b985de55bbe9acae6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.288545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbc3d7-57c7-45ec-968e-7b75512a59e9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.302938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1278/2572] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:03 2022] PUT /identity/v3/projects/02bc5aa90be8449dabea58941bbfa9c5/users/9a44f933d2c0424b985de55bbe9acae6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:03.317722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.317722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.317722 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.318289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1295/2573] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:03 2022] PUT /identity/v3/projects/77b87641a5134d55903c6ea1be3617f4/users/b904d3176a1142d99feef26f39348854/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:03.320346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.320621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.321004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.353339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] MFA Rules not processed for user `9a44f933d2c0424b985de55bbe9acae6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:03.354792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:03.360933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] MFA Rules not processed for user `b904d3176a1142d99feef26f39348854`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:03.362089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:03.418578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:03.453844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1296/2574] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:03.469133 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.472896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:03.492974 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1279/2575] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:03 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:03.509607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.516692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:03.568303 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1a60f-75ff-41e1-b377-82cf078006fa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.581535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.582212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.584407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.584407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.597029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704fa0e-a465-40e0-83ea-5d52a927831b None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.602022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.604407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.604407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.605425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.618661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.620140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.630724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1280/2576] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:03 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:03.655910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.657435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.672818 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1297/2577] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:03.713089 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:03.722291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd93ce-e224-4e8d-b34a-817e5839faa3 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:03.726500 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fe4524-a5eb-4296-a5b2-3b94eaa57f75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:03.727159 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4524-a5eb-4296-a5b2-3b94eaa57f75 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:03.727584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4524-a5eb-4296-a5b2-3b94eaa57f75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:03.727872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe4524-a5eb-4296-a5b2-3b94eaa57f75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:03.736127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:03.815339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe4524-a5eb-4296-a5b2-3b94eaa57f75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:03.819366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fe4524-a5eb-4296-a5b2-3b94eaa57f75 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:03.830659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1281/2578] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:03 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:06.374703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:06.463840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7bff3-7424-4fb6-8fc6-cb5fdb69f762 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:06.469796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:06.470914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:06.471225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:06.471574 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] PATH_INFO: `/v3/users/eae472f14246421db063f6ce415f9a85` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:06.472902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae472f14246421db063f6ce415f9a85)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:06.475321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:06.521403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:06.532047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae472f14246421db063f6ce415f9a85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.546531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae472f14246421db063f6ce415f9a85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.556117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae472f14246421db063f6ce415f9a85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.570377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae472f14246421db063f6ce415f9a85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.571264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae472f14246421db063f6ce415f9a85'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.579393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1298/2579] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:06 2022] DELETE /identity/v3/users/eae472f14246421db063f6ce415f9a85 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:06.583953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:06.584475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:06.584761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:06.602738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:06.603980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:06.667041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1282/2580] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:06.676982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:06.678380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:06.743331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc962dc-9115-42da-88be-b2aeea9803c9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:06.752850 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:06.754805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55688d56-77d5-4d87-9c0a-4a2f433d103e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:06.755769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55688d56-77d5-4d87-9c0a-4a2f433d103e service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:06.756296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55688d56-77d5-4d87-9c0a-4a2f433d103e service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:06.756644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55688d56-77d5-4d87-9c0a-4a2f433d103e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:06.757612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:06.771263 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55688d56-77d5-4d87-9c0a-4a2f433d103e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:06.772847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55688d56-77d5-4d87-9c0a-4a2f433d103e service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:06.786190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1299/2581] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:06.788528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908d48f-9413-4545-974d-c82f2d47c044 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:06.794583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:06.795555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:06.795951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:06.796582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] PATH_INFO: `/v3/users/5419b9b1f26e4acca9b2b52648f346f4` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:06.799042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5419b9b1f26e4acca9b2b52648f346f4)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:06.801123 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:06.891254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5419b9b1f26e4acca9b2b52648f346f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.915005 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5419b9b1f26e4acca9b2b52648f346f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.939399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5419b9b1f26e4acca9b2b52648f346f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.940318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5419b9b1f26e4acca9b2b52648f346f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.958830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5419b9b1f26e4acca9b2b52648f346f4'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:06.970410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1283/2582] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:06 2022] DELETE /identity/v3/users/5419b9b1f26e4acca9b2b52648f346f4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:06.975187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:06.976037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:06.976495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.033688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:07.034939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.115363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.116874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.151835 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1300/2583] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:07.163827 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:07.170769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.172905 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.295671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea42309-721e-4437-a7a0-7ad660780a54 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:07.301067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:07.302107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:07.302587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:07.302965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] PATH_INFO: `/v3/users/996f767ef6e843ffa49b893ddd832889` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.304494 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] RBAC: Authorizing `identity:delete_user(user_id=996f767ef6e843ffa49b893ddd832889)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:07.307292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:07.332440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd7c07b-f4af-415b-bd2c-2ba33aa4df8e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:07.338320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:07.339061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:07.339356 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:07.339626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.351342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:07.352788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:07.360064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:07.367614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1301/2584] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:07.373247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.373247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.396126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc009c8-d305-4cef-919c-43f39e6e3082 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:07.399116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996f767ef6e843ffa49b893ddd832889'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.405414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:07.406882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:07.408202 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:07.408699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] PATH_INFO: `/v3/projects/c684b5611052444facb0382acd563068` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.411962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c684b5611052444facb0382acd563068)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:07.415326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:07.419823 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996f767ef6e843ffa49b893ddd832889'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.430317 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996f767ef6e843ffa49b893ddd832889'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.431232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996f767ef6e843ffa49b893ddd832889'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.439876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996f767ef6e843ffa49b893ddd832889'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.458222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1284/2585] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:07 2022] DELETE /identity/v3/users/996f767ef6e843ffa49b893ddd832889 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:07.507496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c684b5611052444facb0382acd563068', 'request_id': 'req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.517124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c684b5611052444facb0382acd563068', 'request_id': 'req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.530323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c684b5611052444facb0382acd563068', 'request_id': 'req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.550633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] The token cache is being invalidate because project c684b5611052444facb0382acd563068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:07.550944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.552573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.555988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1302/2586] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:07 2022] DELETE /identity/v3/projects/c684b5611052444facb0382acd563068 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:07.560750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.563215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.643613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12d7d93-9657-4efc-afda-2227569a765e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:07.692088 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:07.707469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:07.708367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:07.708630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:07.708902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] PATH_INFO: `/v3/users/b904d3176a1142d99feef26f39348854` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.710125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b904d3176a1142d99feef26f39348854)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:07.712171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:07.770804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b904d3176a1142d99feef26f39348854'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.780483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.782441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.787865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b904d3176a1142d99feef26f39348854'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.798609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b904d3176a1142d99feef26f39348854'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.799475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b904d3176a1142d99feef26f39348854'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.804448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcf0964-a8c0-404e-b45b-8a7cdde9ae54 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:07.810193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:07.812988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:07.813283 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:07.813562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] PATH_INFO: `/v3/projects/169fb46470a04288b947bd729540099b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.814916 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169fb46470a04288b947bd729540099b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:07.815380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b904d3176a1142d99feef26f39348854'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.816856 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:07.828476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1285/2587] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:07 2022] DELETE /identity/v3/users/b904d3176a1142d99feef26f39348854 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:07.829403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.832498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.900969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169fb46470a04288b947bd729540099b', 'request_id': 'req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.909168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169fb46470a04288b947bd729540099b', 'request_id': 'req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.919566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169fb46470a04288b947bd729540099b', 'request_id': 'req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.923433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d54a7e-383e-47d7-8285-92e7ead2c581 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:07.932443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] The token cache is being invalidate because project 169fb46470a04288b947bd729540099b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:07.932732 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.933441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:07.935055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1303/2588] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:07 2022] DELETE /identity/v3/projects/169fb46470a04288b947bd729540099b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:07.939369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:07.940859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:07.991208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:07.992054 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:07.992324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:07.992598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] PATH_INFO: `/v3/projects/3ae5050239b04805a0945b65254f441d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:07.993890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ae5050239b04805a0945b65254f441d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:07.995792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.017342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:08.019231 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c204081-ccea-4edd-b9fc-fde1e8eaf8d9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.025444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.026514 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.026776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.027051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] PATH_INFO: `/v3/users/70cd84b90f844ba5a91f116bbac217dc` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.028969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70cd84b90f844ba5a91f116bbac217dc)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.031211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.037321 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:08.058473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ae5050239b04805a0945b65254f441d', 'request_id': 'req-1397e0bd-956c-4e14-a925-c7c355edf7e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.066017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ae5050239b04805a0945b65254f441d', 'request_id': 'req-1397e0bd-956c-4e14-a925-c7c355edf7e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.077481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ae5050239b04805a0945b65254f441d', 'request_id': 'req-1397e0bd-956c-4e14-a925-c7c355edf7e0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.091932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70cd84b90f844ba5a91f116bbac217dc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.092237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] The token cache is being invalidate because project 3ae5050239b04805a0945b65254f441d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:08.092855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.093819 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-1397e0bd-956c-4e14-a925-c7c355edf7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.095930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1286/2589] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:07 2022] DELETE /identity/v3/projects/3ae5050239b04805a0945b65254f441d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:08.100489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56898bb3-6345-4f01-b20f-917150077c20 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.100918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56898bb3-6345-4f01-b20f-917150077c20 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.101206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56898bb3-6345-4f01-b20f-917150077c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.104922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70cd84b90f844ba5a91f116bbac217dc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.116334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70cd84b90f844ba5a91f116bbac217dc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.122098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-56898bb3-6345-4f01-b20f-917150077c20 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:08.123377 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-56898bb3-6345-4f01-b20f-917150077c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.124318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70cd84b90f844ba5a91f116bbac217dc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.125181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70cd84b90f844ba5a91f116bbac217dc'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.131939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1304/2590] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:07 2022] DELETE /identity/v3/users/70cd84b90f844ba5a91f116bbac217dc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:08.173062 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.174964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.207276 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1287/2591] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:08.209752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.210042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.210316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.232571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:08.234000 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.271870 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24efed-ed3a-4288-be22-c3acfc8539e6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.280217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.281470 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.282034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.282316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] PATH_INFO: `/v3/projects/77b87641a5134d55903c6ea1be3617f4` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.283722 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=77b87641a5134d55903c6ea1be3617f4)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.285952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.300589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1288/2592] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:08.304912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.317678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb537ac-d053-4c72-964e-423916591b94 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.322600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.323320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.323601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.323889 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.324614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:08.324915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.326597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.340426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1289/2593] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:08.341267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.343110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.359228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb67d6c-d6d0-44a5-a6d4-6423af011459 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.375350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77b87641a5134d55903c6ea1be3617f4', 'request_id': 'req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.389102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77b87641a5134d55903c6ea1be3617f4', 'request_id': 'req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.403168 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77b87641a5134d55903c6ea1be3617f4', 'request_id': 'req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.416098 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:08.417507 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] The token cache is being invalidate because project 77b87641a5134d55903c6ea1be3617f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:08.418147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.418687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.420628 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1305/2594] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:08 2022] DELETE /identity/v3/projects/77b87641a5134d55903c6ea1be3617f4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:08.421691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.424080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.451100 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:08.454929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.455903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.456232 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.456544 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] PATH_INFO: `/v3/projects/9c9b420ebb654a0ab08c3c9087974f09` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.458039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c9b420ebb654a0ab08c3c9087974f09)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.459980 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.506889 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c63ff-4f1b-4ba7-af49-8f53002481ef admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.513762 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c9b420ebb654a0ab08c3c9087974f09', 'request_id': 'req-d812c3fb-f351-4d1f-b66d-f7d7754178f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.523879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c9b420ebb654a0ab08c3c9087974f09', 'request_id': 'req-d812c3fb-f351-4d1f-b66d-f7d7754178f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.533776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c9b420ebb654a0ab08c3c9087974f09', 'request_id': 'req-d812c3fb-f351-4d1f-b66d-f7d7754178f6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.545783 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] The token cache is being invalidate because project 9c9b420ebb654a0ab08c3c9087974f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:08.546067 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.546748 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d812c3fb-f351-4d1f-b66d-f7d7754178f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.548328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1290/2595] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:08 2022] DELETE /identity/v3/projects/9c9b420ebb654a0ab08c3c9087974f09 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:08.549671 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.549967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.550239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.571629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:08.572816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.586875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.587725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.588316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.588661 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.589444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.591573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.622385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1306/2596] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:08.623476 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.625351 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.646301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1291/2597] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:08.647162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.648498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.661616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c25bcf-5822-484b-a89e-822925ae7ebf None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.706730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eefc4c-420f-438a-9e25-d17557152eae admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.711927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.712878 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.713160 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.713441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] PATH_INFO: `/v3/users/a545ad292abd4a04abb5ccf43c74350b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.714872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a545ad292abd4a04abb5ccf43c74350b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.716853 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.729839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469f146-a8a0-43b7-b839-bd965d417ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.730865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469f146-a8a0-43b7-b839-bd965d417ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.731153 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469f146-a8a0-43b7-b839-bd965d417ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.731430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469f146-a8a0-43b7-b839-bd965d417ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.732127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469f146-a8a0-43b7-b839-bd965d417ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.734228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469f146-a8a0-43b7-b839-bd965d417ad9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.743529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:08.763861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1292/2598] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:08.765837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.766213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.766548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.779637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a545ad292abd4a04abb5ccf43c74350b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.783259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:08.786701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:08.787927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.797274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a545ad292abd4a04abb5ccf43c74350b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.798065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1293/2599] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:08.798957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.809391 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a545ad292abd4a04abb5ccf43c74350b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.809614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39a2fb-bc50-4f9a-b446-9a1f97ce73f0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.814715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8bf8aa-563a-4095-925c-f0f9343cdc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.815397 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf8aa-563a-4095-925c-f0f9343cdc48 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.815676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf8aa-563a-4095-925c-f0f9343cdc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.815945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8bf8aa-563a-4095-925c-f0f9343cdc48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.816667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bf8aa-563a-4095-925c-f0f9343cdc48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.818265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8bf8aa-563a-4095-925c-f0f9343cdc48 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.818567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a545ad292abd4a04abb5ccf43c74350b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.819301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a545ad292abd4a04abb5ccf43c74350b'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:08.826021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1307/2600] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:08 2022] DELETE /identity/v3/users/a545ad292abd4a04abb5ccf43c74350b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:08.826974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.828317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.829140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1294/2601] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:08.830774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.831044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.831316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.848414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:08.849602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.896943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804178be-44c8-4126-9fe0-1cdfbcdbd3a9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.901692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.902397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.902704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.902983 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.903721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:08.904029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.905693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.914886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1295/2602] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:08.915508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.916768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.924122 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1308/2603] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:08.924719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.926392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:08.929479 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ff0da-255b-4ab4-9573-a54fadad8d57 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.933982 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.934665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.934942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.935211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.935927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.937620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.948678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1296/2604] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:08.949674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:08.960885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d475a-0cbc-4b09-a537-5d76f61ca04e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.966234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.966934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.967221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.967647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.968378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:08.970396 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:08.985795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2f9f-2326-4689-9e7f-ec2c66380d38 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:08.989455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:08.990267 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:08.990669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:08.990927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:08.999444 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1297/2605] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:08 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:09.000348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.006310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.007821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.018300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1309/2606] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:09.019135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.028806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f54697a-c0f5-48de-8274-9b4b92e59d18 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.074372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794be171-0de6-4bfd-930a-41e6bde4ec45 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.086659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.087645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.088038 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.088320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] PATH_INFO: `/v3/projects/ad4ed633c04446e3bc42bbc3bb25fda1/users/00496ba7fac84207a9ef83b6eb9f927b/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.103999 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4368dbb-0bd4-448f-b523-c62c56f297fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.104739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4368dbb-0bd4-448f-b523-c62c56f297fc admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.105042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4368dbb-0bd4-448f-b523-c62c56f297fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.105296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4368dbb-0bd4-448f-b523-c62c56f297fc admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.106154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4368dbb-0bd4-448f-b523-c62c56f297fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.108379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4368dbb-0bd4-448f-b523-c62c56f297fc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.108727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4ed633c04446e3bc42bbc3bb25fda1, user_id=00496ba7fac84207a9ef83b6eb9f927b, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.111910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.118544 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:09.130199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1298/2607] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:08 2022] PUT /identity/v3/projects/ad4ed633c04446e3bc42bbc3bb25fda1/users/00496ba7fac84207a9ef83b6eb9f927b/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:09.138328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1310/2608] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:09 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:09.139520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.144316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.144668 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.145479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.174117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:09.179015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] MFA Rules not processed for user `00496ba7fac84207a9ef83b6eb9f927b`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:09.180545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:09.227630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526ec54-8b4a-49e2-96bf-b1fb6d4dba24 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.233228 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.234018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.234309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.235862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.236647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.238638 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.249218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1299/2609] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:09.253620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.264744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c8f8c-5589-4fb4-90bb-d314542f37a3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.267274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1311/2610] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:09.270870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.271932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.272294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.272647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.273458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.275265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.285249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.287014 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:09.287573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1300/2611] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:09.291531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.303251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f9ec0-8a99-482b-b458-acc5f2adee25 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.308728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.309648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.309920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.310191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] PATH_INFO: `/v3/projects/1c80ba395e6141b7a102fe4bfdc427c2/users/23e88113582f4866b2e322b1afd20ec3/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.333130 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c80ba395e6141b7a102fe4bfdc427c2, user_id=23e88113582f4866b2e322b1afd20ec3, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.335896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.352584 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1301/2612] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:09 2022] PUT /identity/v3/projects/1c80ba395e6141b7a102fe4bfdc427c2/users/23e88113582f4866b2e322b1afd20ec3/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:09.353426 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.355188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:09.383236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcc1eb-bbe0-44a8-9883-82962be9acc0 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.426702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15c58-ea57-4167-9d94-76247ec2262a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.431465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.432345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.432630 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.433060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] PATH_INFO: `/v3/projects/1e8720c7b87c4ff0acffdd08adeb371d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.434107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e8720c7b87c4ff0acffdd08adeb371d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.436165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.450402 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.451099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.451384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.451716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.469779 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:09.489398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e8720c7b87c4ff0acffdd08adeb371d', 'request_id': 'req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.495960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e8720c7b87c4ff0acffdd08adeb371d', 'request_id': 'req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.504521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e8720c7b87c4ff0acffdd08adeb371d', 'request_id': 'req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.515987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] The token cache is being invalidate because project 1e8720c7b87c4ff0acffdd08adeb371d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:09.516268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.516997 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3b01b5b8-d2b7-43cb-b82a-0aee61795c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.518895 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1302/2613] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:09 2022] DELETE /identity/v3/projects/1e8720c7b87c4ff0acffdd08adeb371d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:09.519266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.520387 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.520701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.520987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.521367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.531193 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1312/2614] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:09.532167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.539680 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:09.540878 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:09.542612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a3833-bc52-40da-9760-71cc0d7b4384 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.551588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:09.613901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1303/2615] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:09.624790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.625713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.625993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.626563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] PATH_INFO: `/v3/users/9a44f933d2c0424b985de55bbe9acae6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.627647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a44f933d2c0424b985de55bbe9acae6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.628267 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.629601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.629726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:09.695228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a44f933d2c0424b985de55bbe9acae6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.707198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e5f82-385f-4aef-88ea-f24ec41bf645 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.710564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a44f933d2c0424b985de55bbe9acae6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.710939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.711650 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.711934 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.712212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.719989 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a44f933d2c0424b985de55bbe9acae6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.723218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.724702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.729152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a44f933d2c0424b985de55bbe9acae6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.730136 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-523bd42c-e53f-470c-a04f-59dcf0cb524f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a44f933d2c0424b985de55bbe9acae6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.735428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1304/2616] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:09.737408 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1313/2617] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:09 2022] DELETE /identity/v3/users/9a44f933d2c0424b985de55bbe9acae6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:09.803277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:09.804842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:09.820312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfb7b-57d7-4a9f-a5ef-1b7548c9c1f3 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:09.891065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:09.892687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:09.893092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:09.894310 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] PATH_INFO: `/v3/users/00496ba7fac84207a9ef83b6eb9f927b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:09.895614 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=00496ba7fac84207a9ef83b6eb9f927b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:09.897843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:09.972376 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00496ba7fac84207a9ef83b6eb9f927b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.984654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:09.987114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00496ba7fac84207a9ef83b6eb9f927b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.997166 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00496ba7fac84207a9ef83b6eb9f927b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:09.998133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00496ba7fac84207a9ef83b6eb9f927b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.015537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00496ba7fac84207a9ef83b6eb9f927b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.027446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1305/2618] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:09 2022] DELETE /identity/v3/users/00496ba7fac84207a9ef83b6eb9f927b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:10.029354 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.029645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.029958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.054914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:10.056137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.083236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.084973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.110968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:10.179643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1314/2619] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:10.193691 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.195310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.196386 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab727d23-850e-4f9b-8cfb-1b1f504e28fc admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.203541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.204806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.205116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.205399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] PATH_INFO: `/v3/projects/02bc5aa90be8449dabea58941bbfa9c5` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.206802 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bc5aa90be8449dabea58941bbfa9c5)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.209547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.266807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3a61d-d6a0-4d61-aeba-a34397252e35 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.269158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bc5aa90be8449dabea58941bbfa9c5', 'request_id': 'req-cfd237c9-ab73-440e-8a82-fe5f34889ba0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.276398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bc5aa90be8449dabea58941bbfa9c5', 'request_id': 'req-cfd237c9-ab73-440e-8a82-fe5f34889ba0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.285411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bc5aa90be8449dabea58941bbfa9c5', 'request_id': 'req-cfd237c9-ab73-440e-8a82-fe5f34889ba0'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.297591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] The token cache is being invalidate because project 02bc5aa90be8449dabea58941bbfa9c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:10.298020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.298656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cfd237c9-ab73-440e-8a82-fe5f34889ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.300678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1306/2620] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:10 2022] DELETE /identity/v3/projects/02bc5aa90be8449dabea58941bbfa9c5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:10.305109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b3004-99c1-48cc-99bf-7621d096d63d None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.305401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b3004-99c1-48cc-99bf-7621d096d63d None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.305682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74b3004-99c1-48cc-99bf-7621d096d63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.325715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b74b3004-99c1-48cc-99bf-7621d096d63d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:10.327328 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b74b3004-99c1-48cc-99bf-7621d096d63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.333913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.334928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.335219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.335497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.337603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.412093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1307/2621] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:10.421749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.422204 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.422577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.437292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.437292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575f18d-d9c3-480b-ac0e-5f7b9364b908 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.443742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1315/2622] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:10.445493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.445493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.445693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.475605 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] MFA Rules not processed for user `23e88113582f4866b2e322b1afd20ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:10.476749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:10.476880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.478111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.488601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1308/2623] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:10.494017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.500358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:10.507512 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecd634b-b85c-4dfa-8636-9e5e7cb8869a None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.516542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.517554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.517939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.518553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.519569 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:10.520466 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.522861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.526407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:10.542955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1309/2624] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:10.549079 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.560903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d9923a-7ddc-4420-bf50-f02fdec47260 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.568108 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.568776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.569057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.569325 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.570385 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.573190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.584457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1316/2625] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:10.593082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.595324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.608812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1310/2626] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:10.612874 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.680034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f76d0-5b3a-4628-8f77-3f8c7877ab5c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.689492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac050e-3bf7-46d1-ac93-7d78a638d177 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.701259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.702168 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.702483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.702757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.703455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.705394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.731921 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1311/2627] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/users => generated 291 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:10.733393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.735729 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.736496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.737171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.737171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.743866 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d31de-ca6f-4287-9e61-d1e978ea93e9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.749359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.750022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.750304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.750602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.751427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.752899 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.765531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1312/2628] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:10.769579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.779961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d25457-84f8-4124-8d31-32b1c22b38f1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.785220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.785955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.786071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.786287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.787241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.789292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.801097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1313/2629] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:10.805200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.808198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.809684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.820907 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1317/2630] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:10.821318 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc9166-4286-4d3f-ad43-6aa9bdc0ffa5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.823452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:10.825207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.827702 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83f617-a723-43e9-bf97-ce37c92215f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.828501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83f617-a723-43e9-bf97-ce37c92215f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.828788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83f617-a723-43e9-bf97-ce37c92215f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.829065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83f617-a723-43e9-bf97-ce37c92215f4 admin admin] PATH_INFO: `/v3/projects/a45aaf40844d4faebda762dc6f4b3f4e/users/cec8d656a25446c08d2d91f4c6f27bf2/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.846849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83f617-a723-43e9-bf97-ce37c92215f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45aaf40844d4faebda762dc6f4b3f4e, user_id=cec8d656a25446c08d2d91f4c6f27bf2, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.849676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83f617-a723-43e9-bf97-ce37c92215f4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.852478 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b009f-ec0a-4013-9ce1-a57ad14d87e6 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:10.857674 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:10.858700 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.859031 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.859310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] PATH_INFO: `/v3/projects/ad4ed633c04446e3bc42bbc3bb25fda1` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.860433 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4ed633c04446e3bc42bbc3bb25fda1)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:10.862320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:10.865912 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1314/2631] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:10 2022] PUT /identity/v3/projects/a45aaf40844d4faebda762dc6f4b3f4e/users/cec8d656a25446c08d2d91f4c6f27bf2/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:10.876772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.877227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.877394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.910516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] MFA Rules not processed for user `cec8d656a25446c08d2d91f4c6f27bf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:10.911918 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.915830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:10.926811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4ed633c04446e3bc42bbc3bb25fda1', 'request_id': 'req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.934986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4ed633c04446e3bc42bbc3bb25fda1', 'request_id': 'req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.945102 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4ed633c04446e3bc42bbc3bb25fda1', 'request_id': 'req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.959495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] The token cache is being invalidate because project ad4ed633c04446e3bc42bbc3bb25fda1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:10.959783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.960446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-6ad38c9a-f96e-494d-b238-10b06dd6b7a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:10.962029 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1318/2632] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:10 2022] DELETE /identity/v3/projects/ad4ed633c04446e3bc42bbc3bb25fda1 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:10.969228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183accf-cdc9-421d-9e18-7868e3441e1d None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:10.969543 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183accf-cdc9-421d-9e18-7868e3441e1d None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:10.969795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183accf-cdc9-421d-9e18-7868e3441e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:10.990238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-2183accf-cdc9-421d-9e18-7868e3441e1d None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:10.991630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2183accf-cdc9-421d-9e18-7868e3441e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:10.995977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:11.000026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1315/2633] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:11.004214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.006211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:11.074322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1319/2634] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:11.083858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.084276 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.084505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.087294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac94004-bdfc-460e-a961-e314839afaa0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.094790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.095465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.095737 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.096011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.096707 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.098757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.112352 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:11.113621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:11.126802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1320/2635] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:11.128512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.136694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1316/2636] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:11.141943 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.143469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3a294-3860-46eb-80a9-c5edcf404e66 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.223875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.224809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.225222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.225643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.226635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:11.226953 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.228830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.229960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1bd10e-f9b8-434c-96f1-53d96125b0a3 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.235587 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.236291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.236577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.237060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.237932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.239931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.244021 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1321/2637] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:11.250305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.263401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1317/2638] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:11.264306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed70c7-7102-49ae-a5ff-d9610952e8e0 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.267718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.270584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.271403 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.271798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.272149 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.272985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.275009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.277868 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed911f17-2c21-48a1-abb6-d453a7ccd112 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.282550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.283206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.283487 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.283758 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.284474 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.286056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.300751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1318/2639] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:11.301776 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.308323 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1322/2640] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:11.312251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbb116-e22d-4021-ad7a-13dd72b4deb2 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.312608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.348811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:11.372280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.373312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.373791 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.377574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] PATH_INFO: `/v3/projects/183f549216bb458ab0093d4982f846c8/users/7f1cec759d2244eb895ef55956aaa8b9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.382797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a776f78-7d4d-414f-a858-98121beb8846 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.386522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:11.388646 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.389554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.389554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.390287 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.391313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.393584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.395344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] RBAC: Authorizing `identity:create_grant(project_id=183f549216bb458ab0093d4982f846c8, user_id=7f1cec759d2244eb895ef55956aaa8b9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.398237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.416346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1319/2641] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:11 2022] PUT /identity/v3/projects/183f549216bb458ab0093d4982f846c8/users/7f1cec759d2244eb895ef55956aaa8b9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:11.418521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1323/2642] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/users => generated 303 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:11.420535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.421359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.432042 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22fb5-36a7-4a20-97cd-f4ac73bab2e5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.488033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618eae20-5ade-48a3-ad80-132dd8d0a85b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.493001 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.493742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.494124 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.494406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.495160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.495693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.496371 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.496658 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.497009 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.497175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.497666 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.499955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.512293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1320/2643] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:11.512450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1324/2644] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:11.513701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.515499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.524902 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5e95e1-d2d6-4dae-8e39-655b3c1516d4 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.526659 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7b120a-5b9e-4ba1-9775-40d0b7a4061c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.530125 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f8f2e-81de-4db4-a7bb-7d1fdd912e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.531097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8f2e-81de-4db4-a7bb-7d1fdd912e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.531555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8f2e-81de-4db4-a7bb-7d1fdd912e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.531884 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f8f2e-81de-4db4-a7bb-7d1fdd912e3e admin admin] PATH_INFO: `/v3/projects/183f549216bb458ab0093d4982f846c8/users/7f1cec759d2244eb895ef55956aaa8b9/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.532504 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.533432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.533648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.533998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.534126 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8f2e-81de-4db4-a7bb-7d1fdd912e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=183f549216bb458ab0093d4982f846c8, user_id=7f1cec759d2244eb895ef55956aaa8b9, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.534678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.536252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.536703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f8f2e-81de-4db4-a7bb-7d1fdd912e3e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.546936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1325/2645] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:11.548929 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1321/2646] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:11 2022] PUT /identity/v3/projects/183f549216bb458ab0093d4982f846c8/users/7f1cec759d2244eb895ef55956aaa8b9/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:11.551416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.560264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e2a09-8179-4c5b-8c4e-2dea951887bf None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.560717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e2a09-8179-4c5b-8c4e-2dea951887bf None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.561106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1e2a09-8179-4c5b-8c4e-2dea951887bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.562135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69041dc3-3432-4f99-8f12-540a4ffc4799 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.592583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-bc1e2a09-8179-4c5b-8c4e-2dea951887bf None None] MFA Rules not processed for user `7f1cec759d2244eb895ef55956aaa8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:11.593885 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-bc1e2a09-8179-4c5b-8c4e-2dea951887bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:11.626706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.627892 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.628316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.628888 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] PATH_INFO: `/v3/projects/02036244d8764c6f990b845610d735b3/users/fdf449c7cc2c4702b69148ae4554dce1/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.658797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=02036244d8764c6f990b845610d735b3, user_id=fdf449c7cc2c4702b69148ae4554dce1, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.661474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.678662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1326/2647] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:11 2022] PUT /identity/v3/projects/02036244d8764c6f990b845610d735b3/users/fdf449c7cc2c4702b69148ae4554dce1/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:11.682367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1322/2648] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:11.687541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.687911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.688323 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.693990 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.695788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:11.707771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:11.709072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:11.736850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:11.759586 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:11.760332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b6468-1fcc-4a2c-b4ae-bc5d86e9d78f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.764468 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.765088 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.765392 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.765667 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.773243 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1323/2649] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:11.783896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.785294 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:11.827406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.828987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.838806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1327/2650] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:11.842757 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe94583-1aa9-423c-be0b-0bd49e625482 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.846452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20496577-9a0a-46eb-9c72-e0ff1137dfa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.847095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496577-9a0a-46eb-9c72-e0ff1137dfa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.847374 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496577-9a0a-46eb-9c72-e0ff1137dfa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.847654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20496577-9a0a-46eb-9c72-e0ff1137dfa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.857090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496577-9a0a-46eb-9c72-e0ff1137dfa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.858772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20496577-9a0a-46eb-9c72-e0ff1137dfa8 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:11.869033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1324/2651] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:11.911537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:11.921045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a28e3-51d8-4630-93d0-c8ddffda8664 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:11.925435 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:11.926120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:11.926405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:11.926715 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:11.990991 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:11.992538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:12.003793 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1328/2652] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:12.252628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac6592-2798-43d8-b131-524c46e4106e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.252920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac6592-2798-43d8-b131-524c46e4106e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.253200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac6592-2798-43d8-b131-524c46e4106e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.272941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f0ac6592-2798-43d8-b131-524c46e4106e None None] MFA Rules not processed for user `23e88113582f4866b2e322b1afd20ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:12.273886 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f0ac6592-2798-43d8-b131-524c46e4106e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:12.337028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:12.350344 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734cd32b-b251-4541-9353-12fa1631eba7 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:12.354558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1325/2653] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:12.360247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:12.361871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.361871 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.362071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] PATH_INFO: `/v3/users/cec8d656a25446c08d2d91f4c6f27bf2` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.363353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec8d656a25446c08d2d91f4c6f27bf2)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:12.365412 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:12.428261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec8d656a25446c08d2d91f4c6f27bf2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:12.445368 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec8d656a25446c08d2d91f4c6f27bf2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:12.455135 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec8d656a25446c08d2d91f4c6f27bf2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:12.457758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:12.464286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec8d656a25446c08d2d91f4c6f27bf2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:12.465076 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec8d656a25446c08d2d91f4c6f27bf2'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:12.472947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1329/2654] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:12 2022] DELETE /identity/v3/users/cec8d656a25446c08d2d91f4c6f27bf2 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:12.477917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea165-d26b-406b-b361-954acfd7e579 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.478210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea165-d26b-406b-b361-954acfd7e579 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.478527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ea165-d26b-406b-b361-954acfd7e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.497254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9b0ea165-d26b-406b-b361-954acfd7e579 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:12.498458 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9b0ea165-d26b-406b-b361-954acfd7e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:12.594644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1326/2655] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:12.602127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:12.603969 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:12.605778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.606253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.606739 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.642380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] MFA Rules not processed for user `fdf449c7cc2c4702b69148ae4554dce1`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:12.643960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:12.672564 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c45d9c-1575-4956-a9f6-1fd89a6d4354 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:12.676152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:12.676847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.677120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.677394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.689022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:12.690706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:12.690994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:12.705457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1330/2656] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:12.728245 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1327/2657] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:12.732904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:12.734353 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:12.748112 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de635580-7577-4ccd-bf7d-30a96b036767 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:12.753199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:12.753863 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.754146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.754444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.755151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:12.757491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:12.806458 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1331/2658] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:12 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:12.810247 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:12.832106 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07b8e6-013e-4d65-bda1-5d6313041fc9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:12.916947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:12.922411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.922411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.922411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.922411 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:12.923026 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:12.948875 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1328/2659] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:12 2022] POST /identity/v3/users => generated 308 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:12.953524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:12.966171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d6487-a3eb-4c23-9f22-b31c8c78271f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:12.975904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:12.977003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:12.977540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:12.977944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:12.979106 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:12.981204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:12.997252 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1332/2660] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:13.001857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:13.016023 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e676d3-415b-4676-98db-76f76d6538b7 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:13.021742 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:13.022645 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:13.023013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:13.023358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] PATH_INFO: `/v3/projects/c4b8323c797844a6a29ca0f1b3abe6aa/users/cabfefe0a8a046b98c0149d3622de7c6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:13.045988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b8323c797844a6a29ca0f1b3abe6aa, user_id=cabfefe0a8a046b98c0149d3622de7c6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:13.049195 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:13.071250 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1329/2661] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:13 2022] PUT /identity/v3/projects/c4b8323c797844a6a29ca0f1b3abe6aa/users/cabfefe0a8a046b98c0149d3622de7c6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:13.073630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:13.085581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe85b4-32bf-4a8f-a0dc-57065c7dd52c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:13.152655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:13.153348 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:13.153633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:13.153912 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:13.155044 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:13.157009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:13.169638 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1333/2662] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:13.176620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:13.191993 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:13.195674 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d1f24a-eb67-45fe-b806-d055b2e88feb admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:13.197291 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:13.201379 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:13.202481 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:13.202770 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:13.203047 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] PATH_INFO: `/v3/projects/c4b8323c797844a6a29ca0f1b3abe6aa/users/cabfefe0a8a046b98c0149d3622de7c6/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:13.205085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b8323c797844a6a29ca0f1b3abe6aa, user_id=cabfefe0a8a046b98c0149d3622de7c6, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:13.208033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:13.221176 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1330/2663] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:13 2022] PUT /identity/v3/projects/c4b8323c797844a6a29ca0f1b3abe6aa/users/cabfefe0a8a046b98c0149d3622de7c6/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:13.226175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46676037-dbbe-4314-adb5-6ce741662f78 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:13.301759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:13.308508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:13.309532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:13.310454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:13.310807 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] PATH_INFO: `/v3/projects/a45aaf40844d4faebda762dc6f4b3f4e` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:13.312783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45aaf40844d4faebda762dc6f4b3f4e)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:13.315899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:13.382365 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45aaf40844d4faebda762dc6f4b3f4e', 'request_id': 'req-d495ebdf-bd2e-4cbd-b289-d9973572db66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.390022 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45aaf40844d4faebda762dc6f4b3f4e', 'request_id': 'req-d495ebdf-bd2e-4cbd-b289-d9973572db66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.402528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45aaf40844d4faebda762dc6f4b3f4e', 'request_id': 'req-d495ebdf-bd2e-4cbd-b289-d9973572db66'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.415474 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] The token cache is being invalidate because project a45aaf40844d4faebda762dc6f4b3f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:13.415864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.416698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.421361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1334/2664] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:13 2022] DELETE /identity/v3/projects/a45aaf40844d4faebda762dc6f4b3f4e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:13.422640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:13.424353 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:13.438242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84e5732-ec1c-48be-856c-497f926dd6e0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:13.507903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:13.508816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:13.509100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:13.509378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] PATH_INFO: `/v3/users/7f1cec759d2244eb895ef55956aaa8b9` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:13.510728 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1cec759d2244eb895ef55956aaa8b9)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:13.513044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:13.548255 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:13.576258 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1cec759d2244eb895ef55956aaa8b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.593883 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1cec759d2244eb895ef55956aaa8b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.608446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1cec759d2244eb895ef55956aaa8b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.609254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1cec759d2244eb895ef55956aaa8b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.618741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4f2fe745-82f9-42c8-a184-a35a01c83942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1cec759d2244eb895ef55956aaa8b9'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:13.625689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1331/2665] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:13 2022] DELETE /identity/v3/users/7f1cec759d2244eb895ef55956aaa8b9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:14.077432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.091510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d495ebdf-bd2e-4cbd-b289-d9973572db66 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.173057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.173970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.174248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.174536 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] PATH_INFO: `/v3/projects/183f549216bb458ab0093d4982f846c8` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.176233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183f549216bb458ab0093d4982f846c8)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.178219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.251749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183f549216bb458ab0093d4982f846c8', 'request_id': 'req-da54d946-0783-45b5-9748-5c4d0765c4e1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:14.267517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183f549216bb458ab0093d4982f846c8', 'request_id': 'req-da54d946-0783-45b5-9748-5c4d0765c4e1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:14.277206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183f549216bb458ab0093d4982f846c8', 'request_id': 'req-da54d946-0783-45b5-9748-5c4d0765c4e1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:14.290089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] The token cache is being invalidate because project 183f549216bb458ab0093d4982f846c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:14.290501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:14.291233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-da54d946-0783-45b5-9748-5c4d0765c4e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:14.292839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1335/2666] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:14 2022] DELETE /identity/v3/projects/183f549216bb458ab0093d4982f846c8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:14.298517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.299032 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.299138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.320888 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:14.322340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:14.392498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1332/2667] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:14.400315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f842-69de-4f6c-a060-4c4dc51371d8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.400733 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f842-69de-4f6c-a060-4c4dc51371d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.401147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b3f842-69de-4f6c-a060-4c4dc51371d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.422292 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-80b3f842-69de-4f6c-a060-4c4dc51371d8 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:14.423669 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-80b3f842-69de-4f6c-a060-4c4dc51371d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:14.433373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1336/2668] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:14.438180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.452491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17a616b-c3dd-4269-b47c-174f1183a117 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.459307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.460363 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.460493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.460724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.461573 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:14.461898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.464222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.480380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d081-3089-41ea-937d-5043be343e91 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.480735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d081-3089-41ea-937d-5043be343e91 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.481082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f709d081-3089-41ea-937d-5043be343e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.496043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1333/2669] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:14.497547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.507783 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:14.510039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756fda8-8cfa-45b2-ac97-02eaf2a9468b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.517149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.517859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.518191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.518403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.522528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.524485 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.525170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f709d081-3089-41ea-937d-5043be343e91 None None] MFA Rules not processed for user `cabfefe0a8a046b98c0149d3622de7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:14.529379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f709d081-3089-41ea-937d-5043be343e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:14.577655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1334/2670] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/projects => generated 385 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:14.578903 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.631625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1337/2671] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:14.659104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745ba7d-58a2-4f37-ae1f-b69b0eed1a8b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.667248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.668313 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.668749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.669171 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.671199 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.674184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.694237 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:14.703558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1335/2672] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:14.705158 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709d081-3089-41ea-937d-5043be343e91 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.720240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f709d081-3089-41ea-937d-5043be343e91 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.725205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.725901 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.726183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.726483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.727223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.728932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.742462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1338/2673] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:14.744354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.755429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc25ee0-248e-4897-a243-cce29ad2ca5e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.763816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506353bb-d0b1-443f-a984-9ba8d8a8dd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.764808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506353bb-d0b1-443f-a984-9ba8d8a8dd4c admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.765039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506353bb-d0b1-443f-a984-9ba8d8a8dd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.765302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506353bb-d0b1-443f-a984-9ba8d8a8dd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.766033 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506353bb-d0b1-443f-a984-9ba8d8a8dd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.767657 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506353bb-d0b1-443f-a984-9ba8d8a8dd4c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.783274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:14.784200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1336/2674] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:14.794010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a98d73-8d9c-49ce-a134-4d2476d5c10f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:14.799664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:14.801034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.801034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.801275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] PATH_INFO: `/v3/projects/61f56ca351aa485083ea1df9861120a0/users/855f9952d71d4abb89589886be550080/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.818817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f56ca351aa485083ea1df9861120a0, user_id=855f9952d71d4abb89589886be550080, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:14.821575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:14.842453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1339/2675] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:14 2022] PUT /identity/v3/projects/61f56ca351aa485083ea1df9861120a0/users/855f9952d71d4abb89589886be550080/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:14.847456 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:14.848057 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:14.848545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:14.885212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] MFA Rules not processed for user `855f9952d71d4abb89589886be550080`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:14.886543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:14.963434 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1337/2676] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:14.968176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.054262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e079d04-c336-4840-b3d6-f6a7e5ca5650 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.060282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.061006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.061299 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.061872 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.062653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.064602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.106612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1340/2677] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:14 2022] POST /identity/v3/projects => generated 383 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:15.108149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.127739 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.129508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:15.132975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56619fa8-702f-4ac5-9d00-7f595040bff6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.244304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:15.274871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.275795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.276149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.276496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.277476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.279913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.296734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a396bb9-856b-4ab9-9fda-96bbcf596c29 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.302976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.303753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.304099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.304438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.306587 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:15.309417 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1338/2678] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:15 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:15.314352 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.320600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.321702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.331059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf39716-8dc9-466e-a120-304ccca5c63d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.333206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1341/2679] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:15.338664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.339576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.339709 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.340083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.340906 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.342915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.356631 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1339/2680] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:15.361440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.379571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2438da14-3105-421c-85e3-fc305460e440 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.390782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.392384 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.392947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.393324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] PATH_INFO: `/v3/projects/54fff8fafa0149da9af7755b73bbb6f6/users/b6bbe5079d744d199d0399e79da18536/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.424272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fff8fafa0149da9af7755b73bbb6f6, user_id=b6bbe5079d744d199d0399e79da18536, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.427418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.445884 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1342/2681] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:15 2022] PUT /identity/v3/projects/54fff8fafa0149da9af7755b73bbb6f6/users/b6bbe5079d744d199d0399e79da18536/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:15.450103 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.466652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca87380f-1d71-407d-8fe3-1151a7bf2c45 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.537521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:15.545834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f962e8f0-df76-4f88-8f74-1317d364ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.546864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e8f0-df76-4f88-8f74-1317d364ce5b admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.547519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e8f0-df76-4f88-8f74-1317d364ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.548241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f962e8f0-df76-4f88-8f74-1317d364ce5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.549214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e8f0-df76-4f88-8f74-1317d364ce5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.551710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f962e8f0-df76-4f88-8f74-1317d364ce5b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.568816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1340/2682] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:15 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:15.570466 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.581531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d950ad-6054-4994-a3be-47868b0534df admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.586411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.587355 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.587664 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.588227 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] PATH_INFO: `/v3/projects/54fff8fafa0149da9af7755b73bbb6f6/users/b6bbe5079d744d199d0399e79da18536/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.590206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54fff8fafa0149da9af7755b73bbb6f6, user_id=b6bbe5079d744d199d0399e79da18536, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.592961 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.605766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1343/2683] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:15 2022] PUT /identity/v3/projects/54fff8fafa0149da9af7755b73bbb6f6/users/b6bbe5079d744d199d0399e79da18536/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:15.617209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.617577 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.617856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.646061 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] MFA Rules not processed for user `b6bbe5079d744d199d0399e79da18536`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:15.647526 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:15.739848 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1341/2684] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:15.747322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.749295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:15.815979 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a9ced-cc45-47c9-adb7-dbd079f0b731 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:15.819716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:15.820487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:15.820861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:15.821847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:15.893060 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:15.894627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:15.906228 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1344/2685] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:15.992936 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:15.994811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.080984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb0e1a7-5426-442c-bfa7-6abfd720fe3e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:16.086518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:16.087756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:16.087756 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:16.088151 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] PATH_INFO: `/v3/users/fdf449c7cc2c4702b69148ae4554dce1` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:16.089465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf449c7cc2c4702b69148ae4554dce1)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:16.091588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:16.152843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf449c7cc2c4702b69148ae4554dce1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.168597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf449c7cc2c4702b69148ae4554dce1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.180839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf449c7cc2c4702b69148ae4554dce1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.181521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf449c7cc2c4702b69148ae4554dce1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.192443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf449c7cc2c4702b69148ae4554dce1'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.194432 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:16.202985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1342/2686] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:15 2022] DELETE /identity/v3/users/fdf449c7cc2c4702b69148ae4554dce1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:16.324041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:16.325594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.351416 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84662bb7-424c-47be-8723-85afc040d85b service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:16.423011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:16.440159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:16.441477 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:16.442538 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:16.443169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] PATH_INFO: `/v3/users/5dc44e84fa6847ecb1a4e2257840ef40` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:16.445773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc44e84fa6847ecb1a4e2257840ef40)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:16.448995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:16.497837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:16.499673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.515982 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc44e84fa6847ecb1a4e2257840ef40'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.524059 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b27a25-a50b-4198-8762-0e9f3eab39a1 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:16.529297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:16.530820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:16.531109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:16.532543 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] PATH_INFO: `/v3/projects/02036244d8764c6f990b845610d735b3` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:16.533895 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc44e84fa6847ecb1a4e2257840ef40'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.543073 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] RBAC: Authorizing `identity:delete_project(project_id=02036244d8764c6f990b845610d735b3)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:16.545304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:16.546341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc44e84fa6847ecb1a4e2257840ef40'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.553994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc44e84fa6847ecb1a4e2257840ef40'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.554819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-837759d8-3c94-4d2a-bb03-f578bd1969f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc44e84fa6847ecb1a4e2257840ef40'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.561602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1345/2687] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:16 2022] DELETE /identity/v3/users/5dc44e84fa6847ecb1a4e2257840ef40 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:16.565829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:16.566116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:16.566393 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:16.588845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:16.590176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.624419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02036244d8764c6f990b845610d735b3', 'request_id': 'req-ff978171-79f1-4943-a215-46e11c73ffce'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.634845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02036244d8764c6f990b845610d735b3', 'request_id': 'req-ff978171-79f1-4943-a215-46e11c73ffce'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.649852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02036244d8764c6f990b845610d735b3', 'request_id': 'req-ff978171-79f1-4943-a215-46e11c73ffce'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.669462 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] The token cache is being invalidate because project 02036244d8764c6f990b845610d735b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:16.670042 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.671354 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.677330 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1346/2688] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:16.677527 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1343/2689] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:16 2022] DELETE /identity/v3/projects/02036244d8764c6f990b845610d735b3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:16.683547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:16.685125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.687446 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:16.691651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.697788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14bfce-6f5b-41b9-be8e-947ea0f742bf None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:16.772554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff978171-79f1-4943-a215-46e11c73ffce admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:16.776837 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:16.777589 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:16.777832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:16.778169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:16.780306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:16.792194 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:16.793207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:16.793559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:16.793935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] PATH_INFO: `/v3/users/cabfefe0a8a046b98c0149d3622de7c6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:16.795583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabfefe0a8a046b98c0149d3622de7c6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:16.797858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:16.813684 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:16.848975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:16.849398 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabfefe0a8a046b98c0149d3622de7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.850542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:16.860533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1344/2690] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:16.862832 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabfefe0a8a046b98c0149d3622de7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.871341 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabfefe0a8a046b98c0149d3622de7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.879165 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabfefe0a8a046b98c0149d3622de7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.879852 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabfefe0a8a046b98c0149d3622de7c6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:16.885771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1347/2691] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:16 2022] DELETE /identity/v3/users/cabfefe0a8a046b98c0149d3622de7c6 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:17.069037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.070683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.085394 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259072c-67fa-4e6a-bb4f-53051e62c967 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.120063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:17.144819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.146812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.159598 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.160410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.160690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.161187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] PATH_INFO: `/v3/projects/c4b8323c797844a6a29ca0f1b3abe6aa` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.162542 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b8323c797844a6a29ca0f1b3abe6aa)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.164520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.217596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf615950-eccc-4e15-8af3-ba8513979181 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.219196 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b8323c797844a6a29ca0f1b3abe6aa', 'request_id': 'req-27b73e46-5248-4b6c-ab51-55217ca23a52'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.227621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b8323c797844a6a29ca0f1b3abe6aa', 'request_id': 'req-27b73e46-5248-4b6c-ab51-55217ca23a52'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.235738 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b8323c797844a6a29ca0f1b3abe6aa', 'request_id': 'req-27b73e46-5248-4b6c-ab51-55217ca23a52'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.246468 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] The token cache is being invalidate because project c4b8323c797844a6a29ca0f1b3abe6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:17.246841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.247473 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-27b73e46-5248-4b6c-ab51-55217ca23a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.249342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1345/2692] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:17 2022] DELETE /identity/v3/projects/c4b8323c797844a6a29ca0f1b3abe6aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:17.254140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37411-9a72-42b8-bb4b-889b4a3ffd2a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.254663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37411-9a72-42b8-bb4b-889b4a3ffd2a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.254941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b37411-9a72-42b8-bb4b-889b4a3ffd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.273465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-b7b37411-9a72-42b8-bb4b-889b4a3ffd2a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:17.274712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-b7b37411-9a72-42b8-bb4b-889b4a3ffd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.279758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.280939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.281254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.281532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] PATH_INFO: `/v3/projects/50c8c1abfd5042479d37b7fd39b28bdf` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.282764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50c8c1abfd5042479d37b7fd39b28bdf)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.283226 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1346/2693] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:17.290810 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.292234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.292518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.292815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.311861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:17.313184 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.322002 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1347/2694] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:17.325914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.326848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:17.333786 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50c8c1abfd5042479d37b7fd39b28bdf', 'request_id': 'req-01397080-4527-45c4-a6c0-448c051ebfb1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.335640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789f33-3fea-487d-adbc-a29d5c590cfc None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.342001 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50c8c1abfd5042479d37b7fd39b28bdf', 'request_id': 'req-01397080-4527-45c4-a6c0-448c051ebfb1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.350900 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50c8c1abfd5042479d37b7fd39b28bdf', 'request_id': 'req-01397080-4527-45c4-a6c0-448c051ebfb1'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.362891 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] The token cache is being invalidate because project 50c8c1abfd5042479d37b7fd39b28bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:17.363178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.364203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01397080-4527-45c4-a6c0-448c051ebfb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:17.366117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1348/2695] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:17 2022] DELETE /identity/v3/projects/50c8c1abfd5042479d37b7fd39b28bdf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:17.371327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebef6-84d8-4bf3-80c0-44871486d61e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.372067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebef6-84d8-4bf3-80c0-44871486d61e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.372067 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ebef6-84d8-4bf3-80c0-44871486d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.393437 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1f7ebef6-84d8-4bf3-80c0-44871486d61e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:17.394657 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1f7ebef6-84d8-4bf3-80c0-44871486d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.406600 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.407461 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.408082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.408425 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.409304 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:17.409688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.412090 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.446743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1348/2696] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 10:05:17.453212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.457424 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.483835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f077f-cc99-4550-9beb-cbd1449883c9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.490299 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.491144 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.491726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.492013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.493064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.495321 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.500920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1349/2697] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:17.509958 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.510379 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.510777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.540068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1349/2698] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/projects => generated 381 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:17.540604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:17.540604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:17.542143 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.573524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:17.642305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960c6d56-3de7-43c0-92d7-458660b855d8 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.647366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.648053 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.648482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.648759 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.649447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.651398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.656697 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1350/2699] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:17.662632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.675886 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59ef8d-c82b-4ed8-84fa-94b2b2c00237 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.681396 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.682081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.682366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.682770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.683512 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:17.683930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.685602 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.690369 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1350/2700] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:17.695113 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.706324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1351/2701] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:17.709648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.712946 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9704d0-cdad-41d5-bc42-fe45162eba83 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.718264 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.718977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.719268 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.719536 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.720271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.721858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.724576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614793c-0161-487c-8640-e05b690a15cc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.731601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.732282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.732567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.736552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.736692 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1351/2702] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:17.736797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.736797 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.737942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.755162 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e73956-f319-4b81-a978-65561532d7c0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.771410 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.772552 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.773015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.773799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.774781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.776612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.782173 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1352/2703] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/projects => generated 389 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:17.786380 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.807530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1352/2704] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:17.810919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.831780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba235d6-b8bd-4d48-87fd-1fdaf70b5e31 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.865721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:17.900409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909230c-1068-49ff-a54c-5a7afc3ac0fe admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.905624 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.906513 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.906902 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.907281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.908139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.910295 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.919332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fbd48-617b-47a5-9029-30e405f60be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.921029 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fbd48-617b-47a5-9029-30e405f60be4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.922894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fbd48-617b-47a5-9029-30e405f60be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.922894 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fbd48-617b-47a5-9029-30e405f60be4 admin admin] PATH_INFO: `/v3/projects/17dba171cdb44ef5a1a73c443d785e28/users/8e73560eed844e788b63c53253260510/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.936140 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1353/2705] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:17.940446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:17.943074 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fbd48-617b-47a5-9029-30e405f60be4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17dba171cdb44ef5a1a73c443d785e28, user_id=8e73560eed844e788b63c53253260510, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.947049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fbd48-617b-47a5-9029-30e405f60be4 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.953020 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c75493-f042-456a-aec2-7d6cc8f3b378 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:17.959419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:17.959627 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.959906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.960191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.961052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:17.962796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:17.964682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1353/2706] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:17 2022] PUT /identity/v3/projects/17dba171cdb44ef5a1a73c443d785e28/users/8e73560eed844e788b63c53253260510/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:17.975277 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:17.975726 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:17.976506 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:17.981443 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1354/2707] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:17.986333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.000847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf1c5e-b287-4130-9c28-0321e440e362 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.007933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] MFA Rules not processed for user `8e73560eed844e788b63c53253260510`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:18.009222 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:18.074843 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.076249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.076249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.076249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.077625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.080070 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.100914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:18.102344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1354/2708] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:18.103894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1355/2709] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:18.107147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.108553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.119373 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf261f9c-ad35-4fd6-91ac-4e909e76c8fe admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.119698 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2d1a83-2fb9-4b30-b8b0-fbcfa00d720e None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.124594 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fac8e1-c211-4a17-957e-9ba2e6482f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.124994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.125694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fac8e1-c211-4a17-957e-9ba2e6482f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.125809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.126030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fac8e1-c211-4a17-957e-9ba2e6482f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.126178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.126309 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fac8e1-c211-4a17-957e-9ba2e6482f85 admin admin] PATH_INFO: `/v3/projects/aee2537309114f069195d7b9f280628e/users/e7fc8462037c4c7aadc5b3ade3d32b46/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.126599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.127347 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.129362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.144305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fac8e1-c211-4a17-957e-9ba2e6482f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee2537309114f069195d7b9f280628e, user_id=e7fc8462037c4c7aadc5b3ade3d32b46, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.147159 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fac8e1-c211-4a17-957e-9ba2e6482f85 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.157508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1355/2710] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:18 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:18.161508 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.162995 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1356/2711] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:18 2022] PUT /identity/v3/projects/aee2537309114f069195d7b9f280628e/users/e7fc8462037c4c7aadc5b3ade3d32b46/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:18.173243 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.173552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.173826 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.200222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] MFA Rules not processed for user `e7fc8462037c4c7aadc5b3ade3d32b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:18.201362 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:18.229832 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c8f0b-5744-46f9-a9fc-9da40faa3cbe admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.235388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.236139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.236419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.236690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.237388 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.239331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.262391 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1356/2712] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:18 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:18.266476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.267687 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1357/2713] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:18.278621 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.279366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a838daa-40fa-4099-b4fe-8e8dbad39749 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.280196 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:18.286760 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.287942 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.288642 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.289063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.289834 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.292370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.300095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:18.304708 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1357/2714] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:18.308960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.319503 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04460014-ab33-4756-927d-ce867c26cda6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.324358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.325253 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.325537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.325815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] PATH_INFO: `/v3/projects/eac8b88df1174f449154207f9d4986b0/users/49aa2af1f778452da69d4190c8b7814c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.341948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac8b88df1174f449154207f9d4986b0, user_id=49aa2af1f778452da69d4190c8b7814c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.344685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.347728 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f8c89-c5c3-4180-ac8e-34388b6ad039 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.351472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.352121 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.352515 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.352662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.366476 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1358/2715] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:18 2022] PUT /identity/v3/projects/eac8b88df1174f449154207f9d4986b0/users/49aa2af1f778452da69d4190c8b7814c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:18.368529 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.371258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.372915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.384057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1358/2716] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:18.454919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd9f9ec-3f83-468f-af99-c2b77f19a0ff admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.459864 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838c0758-cea2-4dc0-a535-fa53492cae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.460627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0758-cea2-4dc0-a535-fa53492cae5d admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.460969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0758-cea2-4dc0-a535-fa53492cae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.461358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838c0758-cea2-4dc0-a535-fa53492cae5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.462133 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c0758-cea2-4dc0-a535-fa53492cae5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.464131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838c0758-cea2-4dc0-a535-fa53492cae5d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.477554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1359/2717] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:18.481681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.493854 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1832e4-b98e-4332-8621-abf72d953a12 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.500315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.501197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.501500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.501769 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] PATH_INFO: `/v3/projects/eac8b88df1174f449154207f9d4986b0/users/49aa2af1f778452da69d4190c8b7814c/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.503798 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eac8b88df1174f449154207f9d4986b0, user_id=49aa2af1f778452da69d4190c8b7814c, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.506406 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.518271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1359/2718] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:18 2022] PUT /identity/v3/projects/eac8b88df1174f449154207f9d4986b0/users/49aa2af1f778452da69d4190c8b7814c/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:18.528576 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.528865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.529146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.556987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] MFA Rules not processed for user `49aa2af1f778452da69d4190c8b7814c`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:18.558180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:18.577969 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:18.634072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1360/2719] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:18.651644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.653535 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:18.721400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2a990-ecb3-4b5a-99fa-dc53f59b1527 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.725199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.726046 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.726395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.726770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.739249 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.740327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.752460 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1360/2720] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:18 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:18.828201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:18.840599 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0a3a7-94cb-4295-8d72-d587eaeb65b9 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:18.845590 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:18.846284 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:18.846637 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:18.846955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:18.908160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:18.909717 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:18.918621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1361/2721] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:20.324081 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:20.334024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b19ea77-39a5-4b69-88ab-5535c6fd8917 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:20.338486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:20.339229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:20.339582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:20.339915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:20.342522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:20.438312 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:20.440028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862f1a5-05a9-4f3e-b9e4-ee7742fa98d0 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:20.453904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1361/2722] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:28.915140 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=49 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:30.446472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=80,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:35.346448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:35.466343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab1826-e9be-4840-97b4-eeb5663ac228 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:35.471215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:35.472097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:35.472372 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:35.472641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] PATH_INFO: `/v3/users/8e73560eed844e788b63c53253260510` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:35.473816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e73560eed844e788b63c53253260510)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:35.475778 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:35.545380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e73560eed844e788b63c53253260510'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:35.564419 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e73560eed844e788b63c53253260510'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:35.575034 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e73560eed844e788b63c53253260510'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:35.575808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e73560eed844e788b63c53253260510'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:35.585056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c73da30d-f0ea-40be-8445-413f4bb88f13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e73560eed844e788b63c53253260510'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:35.594296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1362/2723] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:35 2022] DELETE /identity/v3/users/8e73560eed844e788b63c53253260510 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:35.599101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:35.601117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:35.601117 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:35.609460 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:35.609752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:35.610030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:35.638588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] MFA Rules not processed for user `23e88113582f4866b2e322b1afd20ec3`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:35.639861 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:35.657211 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:35.658444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:35.667336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:35.705013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1363/2724] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:35.726741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1362/2725] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:35.739224 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:35.740538 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:35.816187 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9983ee15-2aa0-41ef-a726-8736657c9024 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:35.819751 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a164d94-3682-4974-99c1-f7feb3d9eee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:35.820401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164d94-3682-4974-99c1-f7feb3d9eee0 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:35.820678 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164d94-3682-4974-99c1-f7feb3d9eee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:35.820948 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a164d94-3682-4974-99c1-f7feb3d9eee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:35.831085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a164d94-3682-4974-99c1-f7feb3d9eee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:35.832539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a164d94-3682-4974-99c1-f7feb3d9eee0 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:35.843085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1364/2726] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:35.936606 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:35.938655 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:35.951523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000ea9a-9171-453c-bc19-29b70b04eff3 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:35.956802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:35.957719 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:35.957980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:35.958272 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] PATH_INFO: `/v3/users/855f9952d71d4abb89589886be550080` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:35.959519 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=855f9952d71d4abb89589886be550080)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:35.961448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:36.017178 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855f9952d71d4abb89589886be550080'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.030455 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855f9952d71d4abb89589886be550080'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.039510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855f9952d71d4abb89589886be550080'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.046948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855f9952d71d4abb89589886be550080'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.047608 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855f9952d71d4abb89589886be550080'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.054613 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1363/2727] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:35 2022] DELETE /identity/v3/users/855f9952d71d4abb89589886be550080 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:36.059361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:36.059682 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:36.059937 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:36.087780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:36.089072 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:36.166110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1365/2728] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:36.178972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:36.180522 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:36.239713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:36.245922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96f3eb-a94c-4287-bf7c-caec91cbd768 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:36.250940 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:36.252023 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:36.252429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:36.252741 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:36.262972 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:36.264428 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:36.274748 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1364/2729] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:36.370358 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:36.372198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:36.391221 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6cd999-a663-497b-875e-c3d2b100f116 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:36.399610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:36.400830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:36.400961 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:36.401239 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] PATH_INFO: `/v3/projects/17dba171cdb44ef5a1a73c443d785e28` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:36.402829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17dba171cdb44ef5a1a73c443d785e28)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:36.405158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:36.497219 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17dba171cdb44ef5a1a73c443d785e28', 'request_id': 'req-32b11cd7-b40a-4be4-866b-302e85c2621a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.504351 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17dba171cdb44ef5a1a73c443d785e28', 'request_id': 'req-32b11cd7-b40a-4be4-866b-302e85c2621a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.508706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:36.519010 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17dba171cdb44ef5a1a73c443d785e28', 'request_id': 'req-32b11cd7-b40a-4be4-866b-302e85c2621a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.536182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] The token cache is being invalidate because project 17dba171cdb44ef5a1a73c443d785e28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:36.536478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.537209 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.543085 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1366/2730] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:36 2022] DELETE /identity/v3/projects/17dba171cdb44ef5a1a73c443d785e28 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:36.543808 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:36.563138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602d54a-67ed-45b7-a4fd-f3cf4457e6b2 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:36.635146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:36.636152 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:36.636550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:36.636897 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] PATH_INFO: `/v3/users/49aa2af1f778452da69d4190c8b7814c` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:36.640233 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:36.642120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:36.646721 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49aa2af1f778452da69d4190c8b7814c)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:36.648730 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:36.663478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b11cd7-b40a-4be4-866b-302e85c2621a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:36.669177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:36.670003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:36.670286 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:36.670634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] PATH_INFO: `/v3/projects/61f56ca351aa485083ea1df9861120a0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:36.671840 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f56ca351aa485083ea1df9861120a0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:36.674229 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:36.719805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49aa2af1f778452da69d4190c8b7814c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.733988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49aa2af1f778452da69d4190c8b7814c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.739537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f56ca351aa485083ea1df9861120a0', 'request_id': 'req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.746603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49aa2af1f778452da69d4190c8b7814c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.746855 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f56ca351aa485083ea1df9861120a0', 'request_id': 'req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.755239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49aa2af1f778452da69d4190c8b7814c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.756130 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49aa2af1f778452da69d4190c8b7814c'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.756496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f56ca351aa485083ea1df9861120a0', 'request_id': 'req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.763496 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1365/2731] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:36 2022] DELETE /identity/v3/users/49aa2af1f778452da69d4190c8b7814c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:36.774938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] The token cache is being invalidate because project 61f56ca351aa485083ea1df9861120a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:36.775254 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.775950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.778041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1367/2732] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:36 2022] DELETE /identity/v3/projects/61f56ca351aa485083ea1df9861120a0 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:36.782813 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:36.784523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:36.868090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05102122-0d0d-47ec-94fa-1468b0034dc3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:36.873032 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:36.874331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:36.874750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:36.875085 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] PATH_INFO: `/v3/users/b6bbe5079d744d199d0399e79da18536` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:36.876475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6bbe5079d744d199d0399e79da18536)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:36.878583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:36.890980 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:36.935600 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6bbe5079d744d199d0399e79da18536'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.954575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6bbe5079d744d199d0399e79da18536'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.964612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6bbe5079d744d199d0399e79da18536'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.975304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6bbe5079d744d199d0399e79da18536'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.976015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6bbe5079d744d199d0399e79da18536'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:36.984052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1366/2733] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:36 2022] DELETE /identity/v3/users/b6bbe5079d744d199d0399e79da18536 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:37.112852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.116393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:37.237212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb132b-1c83-4f4c-bbad-1685cb7f668b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.302821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.303626 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.303904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.304180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] PATH_INFO: `/v3/projects/eac8b88df1174f449154207f9d4986b0` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.305368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] RBAC: Authorizing `identity:delete_project(project_id=eac8b88df1174f449154207f9d4986b0)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.307327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.317781 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.319268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:37.333913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff827ff-375a-466c-a4c0-dad1b3b07824 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.334771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:37.339185 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.340079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.340366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.340970 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] PATH_INFO: `/v3/projects/54fff8fafa0149da9af7755b73bbb6f6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.342887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54fff8fafa0149da9af7755b73bbb6f6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.344635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.380063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eac8b88df1174f449154207f9d4986b0', 'request_id': 'req-e229be31-32ab-48da-857f-6cc4102c3fef'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.386719 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eac8b88df1174f449154207f9d4986b0', 'request_id': 'req-e229be31-32ab-48da-857f-6cc4102c3fef'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.395843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eac8b88df1174f449154207f9d4986b0', 'request_id': 'req-e229be31-32ab-48da-857f-6cc4102c3fef'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.399071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54fff8fafa0149da9af7755b73bbb6f6', 'request_id': 'req-67452aa7-6e28-4851-829f-abf6fb1b8bc6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.405840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54fff8fafa0149da9af7755b73bbb6f6', 'request_id': 'req-67452aa7-6e28-4851-829f-abf6fb1b8bc6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.412048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] The token cache is being invalidate because project eac8b88df1174f449154207f9d4986b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:37.412315 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.413107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-e229be31-32ab-48da-857f-6cc4102c3fef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.414970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1368/2734] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:37 2022] DELETE /identity/v3/projects/eac8b88df1174f449154207f9d4986b0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:37.419501 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54fff8fafa0149da9af7755b73bbb6f6', 'request_id': 'req-67452aa7-6e28-4851-829f-abf6fb1b8bc6'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.420065 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69008423-ab7e-4b2f-809a-c91000f09d8a None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.420357 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69008423-ab7e-4b2f-809a-c91000f09d8a None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.420644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69008423-ab7e-4b2f-809a-c91000f09d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.430932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] The token cache is being invalidate because project 54fff8fafa0149da9af7755b73bbb6f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:37.431222 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.431869 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-67452aa7-6e28-4851-829f-abf6fb1b8bc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:37.433633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1367/2735] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:37 2022] DELETE /identity/v3/projects/54fff8fafa0149da9af7755b73bbb6f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:37.439662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a52e7-0236-40d4-aa4f-ba36ab3405c7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.439948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a52e7-0236-40d4-aa4f-ba36ab3405c7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.440229 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a52e7-0236-40d4-aa4f-ba36ab3405c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.476082 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-69008423-ab7e-4b2f-809a-c91000f09d8a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:37.477721 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-69008423-ab7e-4b2f-809a-c91000f09d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:37.486521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3d9a52e7-0236-40d4-aa4f-ba36ab3405c7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:37.487726 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3d9a52e7-0236-40d4-aa4f-ba36ab3405c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:37.570942 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:37.574488 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1369/2736] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:37.581223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.581521 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.582080 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.605037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1368/2737] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:37.609035 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:37.610251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:37.614025 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.614311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.614649 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.635145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1370/2738] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:37.639689 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:37.640142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.641120 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:37.653493 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b06e57e-f91e-4c57-a464-96b41702e8b4 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.653817 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1369/2739] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:37.658003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.662046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.662952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.663433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.663927 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.664673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:37.664984 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.666629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.668531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316c55e-e9d4-411f-954f-286f2eafabf7 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.673723 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.674763 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.675049 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.675327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.676061 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:37.676370 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.678204 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.680725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1371/2740] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:37.684607 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.698464 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1370/2741] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 13 10:05:37.701486 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.718825 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404340ff-72b9-4f54-9ae6-de47152fedf9 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.720132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea450d0-169d-4c49-8744-4fbae42182cf admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.725899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.726378 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.726647 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.726928 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.727203 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.727326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.727539 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.727821 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.727933 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.728517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.729867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.730441 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.776041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1372/2742] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/projects => generated 369 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:37.778790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.779087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1371/2743] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:37.783790 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.834200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:37.867591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf56a2-aa5e-4c0d-83fe-066ca7a7945a admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.886576 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472ae22-4d65-4a4a-91ea-15070079065f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.900704 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.901405 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.901688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.901968 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.902717 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.904751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.933533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1372/2744] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:37.937778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.948930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cb1d9-ed06-490e-b312-1b55715a6a38 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:37.954798 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.955535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.955820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.956091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.956547 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:37.956782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.958212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:37.958212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:37.958212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:37.958920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.959385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:37.961201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:37.977189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1373/2745] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:37.981236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.986459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1373/2746] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:37 2022] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:37.991373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:37.997727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815d33a-5bd5-499d-90d1-cf0167c696ed admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.004752 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.005623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.005768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b673d-bb64-4349-ba98-5ff982bed323 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.006071 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.006502 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.007394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.009280 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.012287 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.013771 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.014205 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.014693 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.015687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.017697 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.024836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1374/2747] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:38.026184 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.033931 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1374/2748] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:38.036040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.037899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ce2b4-6ddf-476d-b46b-ffbd10f51a02 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.043317 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff3aab-3711-4f15-9689-4365f41802b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.044421 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3aab-3711-4f15-9689-4365f41802b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.045424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3aab-3711-4f15-9689-4365f41802b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.045424 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff3aab-3711-4f15-9689-4365f41802b7 admin admin] PATH_INFO: `/v3/projects/76cfb8153b36456bb87af6669461ad2d/users/6c981a11a7fb4cdbb6d508e20b57e56a/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.049015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f0b4e-12a2-4ad5-b500-f81deab5b256 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.055164 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.055839 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.056261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.056540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.057261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.059330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.066921 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff3aab-3711-4f15-9689-4365f41802b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76cfb8153b36456bb87af6669461ad2d, user_id=6c981a11a7fb4cdbb6d508e20b57e56a, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.071281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff3aab-3711-4f15-9689-4365f41802b7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.075482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1375/2749] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:38.076442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.088417 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1375/2750] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:38 2022] PUT /identity/v3/projects/76cfb8153b36456bb87af6669461ad2d/users/6c981a11a7fb4cdbb6d508e20b57e56a/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:38.088646 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c13446-da87-4c47-a3e2-2ef6cd3c89b5 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.100490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.100776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.101055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.136567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] MFA Rules not processed for user `6c981a11a7fb4cdbb6d508e20b57e56a`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:38.138578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:38.159621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9562aa-ec3a-40df-a36e-83abd149184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.160582 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9562aa-ec3a-40df-a36e-83abd149184b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.160865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9562aa-ec3a-40df-a36e-83abd149184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.161142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9562aa-ec3a-40df-a36e-83abd149184b admin admin] PATH_INFO: `/v3/projects/f44f430ac20847fcb0e236233336ce77/users/037f052974e94a0fbde6eb99110c851a/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.177442 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9562aa-ec3a-40df-a36e-83abd149184b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44f430ac20847fcb0e236233336ce77, user_id=037f052974e94a0fbde6eb99110c851a, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.180215 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9562aa-ec3a-40df-a36e-83abd149184b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.192457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:38.197291 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1376/2751] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:38 2022] PUT /identity/v3/projects/f44f430ac20847fcb0e236233336ce77/users/037f052974e94a0fbde6eb99110c851a/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:38.209139 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.209428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.209704 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.223134 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1376/2752] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:38.236531 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.238864 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:38.243308 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] MFA Rules not processed for user `037f052974e94a0fbde6eb99110c851a`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:38.244939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:38.283558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:38.315041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaabb0a-c0ed-4189-85c9-39645c112ed4 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.330129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1377/2753] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:05:38.334835 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.384567 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.385190 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.385469 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.385746 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.432191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc114f-44d1-4791-8127-671314d50bb1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.437312 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.438049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.438390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.438867 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.439566 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.441563 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.456271 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.458554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.467986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1377/2754] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:38.476296 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1378/2755] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:38 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:38.480305 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.493692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a1b081-fc77-465f-8734-93159c6e4347 service glance] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.559491 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:38.566083 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.566795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.567074 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.567342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.568047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.570751 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.598524 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1378/2756] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:38 2022] POST /identity/v3/users => generated 291 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:38.599464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.610392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0194726d-838f-4806-a811-c09cdcfa290e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.618629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.619558 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.619750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.620117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.620935 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.622619 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.635175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1379/2757] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:38.639867 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.650218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0647a65-e0aa-4b3c-82b3-1ee12e4c31b5 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.657055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.658244 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.658631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.658977 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] PATH_INFO: `/v3/projects/96a224a31457473fab73d6f29067213c/users/15b4004fefa942fdadabe74de87c9c69/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.675839 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a224a31457473fab73d6f29067213c, user_id=15b4004fefa942fdadabe74de87c9c69, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.678640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.696144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1379/2758] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:38 2022] PUT /identity/v3/projects/96a224a31457473fab73d6f29067213c/users/15b4004fefa942fdadabe74de87c9c69/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:38.700371 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.711251 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e76eef-c8bf-4f00-afce-f75c93e752a6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.813879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14539615-b114-4db9-8cf5-ea7d1b4e4d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.814747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14539615-b114-4db9-8cf5-ea7d1b4e4d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.815110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14539615-b114-4db9-8cf5-ea7d1b4e4d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.815439 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14539615-b114-4db9-8cf5-ea7d1b4e4d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.816356 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14539615-b114-4db9-8cf5-ea7d1b4e4d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.818242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14539615-b114-4db9-8cf5-ea7d1b4e4d6a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.829905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1380/2759] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:38 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:38.834262 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.845132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5f5240-e478-4b42-bef3-84872818667e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:38.850631 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:38.851555 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.851834 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.852124 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] PATH_INFO: `/v3/projects/96a224a31457473fab73d6f29067213c/users/15b4004fefa942fdadabe74de87c9c69/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.854183 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a224a31457473fab73d6f29067213c, user_id=15b4004fefa942fdadabe74de87c9c69, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:38.857073 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:38.869409 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1380/2760] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:38 2022] PUT /identity/v3/projects/96a224a31457473fab73d6f29067213c/users/15b4004fefa942fdadabe74de87c9c69/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:38.882782 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:38.883483 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:38.883928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:38.920687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] MFA Rules not processed for user `15b4004fefa942fdadabe74de87c9c69`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:38.922348 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:38.963662 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:38.977590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:38.980490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:39.036635 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1381/2761] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:38 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:39.051095 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:39.057314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:39.092822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901fe31-0971-424b-a412-202ec9b33383 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:39.099147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:39.100147 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:39.100586 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:39.100875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] PATH_INFO: `/v3/users/e7fc8462037c4c7aadc5b3ade3d32b46` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:39.102138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7fc8462037c4c7aadc5b3ade3d32b46)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:39.104632 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:39.140530 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab2964c-dc76-45a2-bab1-d17379072959 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:39.149475 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e945b70-044b-4c50-895f-213406ed2c32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:39.150161 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945b70-044b-4c50-895f-213406ed2c32 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:39.150453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945b70-044b-4c50-895f-213406ed2c32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:39.150730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e945b70-044b-4c50-895f-213406ed2c32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:39.165706 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7fc8462037c4c7aadc5b3ade3d32b46'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.170343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945b70-044b-4c50-895f-213406ed2c32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:39.172991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e945b70-044b-4c50-895f-213406ed2c32 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:39.187367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1382/2762] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 13 10:05:39.191069 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7fc8462037c4c7aadc5b3ade3d32b46'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.201735 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7fc8462037c4c7aadc5b3ade3d32b46'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.213890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7fc8462037c4c7aadc5b3ade3d32b46'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.214777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7fc8462037c4c7aadc5b3ade3d32b46'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.224754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1381/2763] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:38 2022] DELETE /identity/v3/users/e7fc8462037c4c7aadc5b3ade3d32b46 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:39.230030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:39.230528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:39.230930 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:39.255975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:39.257380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:39.335172 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1383/2764] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:39.349328 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:39.351346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:39.395709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:39.445896 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278c9d3-b361-44cb-83c2-aa9f08026790 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:39.448803 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:39.449560 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:39.449868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:39.450166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:39.463266 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:39.464725 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:39.480904 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1382/2765] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:39.788104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:39.789597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:39.809691 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a7c33-bb5b-4ba1-8568-50ababd62337 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:39.818028 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:39.818941 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:39.819289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:39.819501 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] PATH_INFO: `/v3/projects/aee2537309114f069195d7b9f280628e` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:39.820712 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee2537309114f069195d7b9f280628e)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:39.822743 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:39.874070 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee2537309114f069195d7b9f280628e', 'request_id': 'req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.881341 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee2537309114f069195d7b9f280628e', 'request_id': 'req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.890852 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee2537309114f069195d7b9f280628e', 'request_id': 'req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.892663 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:39.913330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] The token cache is being invalidate because project aee2537309114f069195d7b9f280628e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:39.913330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.913330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d4cb341f-a250-4f39-bbbd-3be65bcbb56a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:39.914554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1384/2766] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:39 2022] DELETE /identity/v3/projects/aee2537309114f069195d7b9f280628e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:40.771254 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:40.772799 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:40.786045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1c579-14cb-414f-90c6-d1cf3938744b service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:40.863397 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:40.864237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:40.864537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:40.864814 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] PATH_INFO: `/v3/users/037f052974e94a0fbde6eb99110c851a` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:40.866089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=037f052974e94a0fbde6eb99110c851a)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:40.868079 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:40.929495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037f052974e94a0fbde6eb99110c851a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:40.945175 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037f052974e94a0fbde6eb99110c851a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:40.955418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037f052974e94a0fbde6eb99110c851a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:40.962929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037f052974e94a0fbde6eb99110c851a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:40.963579 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037f052974e94a0fbde6eb99110c851a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:40.970549 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1383/2767] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:40 2022] DELETE /identity/v3/users/037f052974e94a0fbde6eb99110c851a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:40.975881 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:40.976448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:40.976448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:40.994765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:40.995853 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:41.062027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1385/2768] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:41.074566 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:41.076127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:41.143713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea487-4e79-4487-a6f0-929aa24faba7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:41.147210 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:41.147861 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:41.148139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:41.148429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:41.154170 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:41.158911 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:41.160446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:41.171436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1384/2769] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:41.498272 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:41.499744 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:41.513967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b7b27-d5a8-403a-9279-d220c5262abe None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:41.519723 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:41.521395 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:41.521747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:41.522169 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] PATH_INFO: `/v3/projects/f44f430ac20847fcb0e236233336ce77` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:41.523938 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44f430ac20847fcb0e236233336ce77)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:41.526648 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:41.578857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44f430ac20847fcb0e236233336ce77', 'request_id': 'req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.587915 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44f430ac20847fcb0e236233336ce77', 'request_id': 'req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.599520 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44f430ac20847fcb0e236233336ce77', 'request_id': 'req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.614923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] The token cache is being invalidate because project f44f430ac20847fcb0e236233336ce77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:41.615206 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.615882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.617451 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1386/2770] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:41 2022] DELETE /identity/v3/projects/f44f430ac20847fcb0e236233336ce77 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:41.621846 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:41.634662 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edbf12-fe89-4e28-90cd-93d4cb90c4de service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:41.697052 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:41.697845 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:41.698126 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:41.698401 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] PATH_INFO: `/v3/users/15b4004fefa942fdadabe74de87c9c69` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:41.699652 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] RBAC: Authorizing `identity:delete_user(user_id=15b4004fefa942fdadabe74de87c9c69)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:41.701569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:41.758080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b4004fefa942fdadabe74de87c9c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.775279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b4004fefa942fdadabe74de87c9c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.781971 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b4004fefa942fdadabe74de87c9c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.790294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b4004fefa942fdadabe74de87c9c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.791095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-862ea61f-a80d-43a5-ba66-142727f9e80d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b4004fefa942fdadabe74de87c9c69'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:41.797665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1385/2771] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:41 2022] DELETE /identity/v3/users/15b4004fefa942fdadabe74de87c9c69 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:42.096548 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.098134 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:42.111580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46bdd2-6bd6-4bc9-86da-4cbd445bcf61 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.187820 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.189241 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.189528 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.189806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] PATH_INFO: `/v3/projects/96a224a31457473fab73d6f29067213c` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.191109 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a224a31457473fab73d6f29067213c)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.193060 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.209831 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:42.245654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a224a31457473fab73d6f29067213c', 'request_id': 'req-899672b8-37e5-48de-80a0-f38fefc17d95'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:42.252876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a224a31457473fab73d6f29067213c', 'request_id': 'req-899672b8-37e5-48de-80a0-f38fefc17d95'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:42.263518 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a224a31457473fab73d6f29067213c', 'request_id': 'req-899672b8-37e5-48de-80a0-f38fefc17d95'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:42.276641 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] The token cache is being invalidate because project 96a224a31457473fab73d6f29067213c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:42.276901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:42.277591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-899672b8-37e5-48de-80a0-f38fefc17d95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:42.279207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1387/2772] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:42 2022] DELETE /identity/v3/projects/96a224a31457473fab73d6f29067213c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:42.284792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.285078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.285361 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.307866 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:42.309703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:42.386010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1386/2773] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:42.394664 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.394966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.395227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.415099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:42.416298 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:42.425213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1388/2774] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:42.429710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.440395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b4b37-119c-42da-9906-76ac796285aa None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.445782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.446463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.446775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.447050 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.447782 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:42.448090 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.449711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.459447 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:42.463937 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1387/2775] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:42.469613 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.479437 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d46a82d-9ec6-426f-956b-50e45072a599 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.484259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.484924 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.485227 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.485531 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.486234 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.488368 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.520644 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1389/2776] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:42 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:42.521882 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.532964 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4090bd20-f606-4042-a1d7-2cee310c1271 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.598855 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.599550 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.599836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.600108 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.600840 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.602851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.627614 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1388/2777] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:42 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:42.628838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.640370 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aeb3b1-a727-4350-b3b9-ab2ce04daf16 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.648331 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.649084 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.649389 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.649667 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.650455 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.652102 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.664499 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1390/2778] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:42.668533 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.679320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd488c-f32b-48b4-a105-cc18c8120201 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.683932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d430001-9eb0-4309-9fc1-2a06b27b7df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.684633 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430001-9eb0-4309-9fc1-2a06b27b7df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.684998 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430001-9eb0-4309-9fc1-2a06b27b7df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.685383 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d430001-9eb0-4309-9fc1-2a06b27b7df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.686290 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430001-9eb0-4309-9fc1-2a06b27b7df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.688418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d430001-9eb0-4309-9fc1-2a06b27b7df2 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.700571 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1389/2779] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:42.705519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.721300 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2815126-2662-4467-961d-9b6796f30a97 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.726629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.727557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.727841 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.728117 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] PATH_INFO: `/v3/projects/a02aabb3cd7148f9a38aa7806b8fa9e3/users/d6b968bcdb254336b92abc5313875a6b/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.746813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02aabb3cd7148f9a38aa7806b8fa9e3, user_id=d6b968bcdb254336b92abc5313875a6b, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.749517 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:42.769428 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1391/2780] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:42 2022] PUT /identity/v3/projects/a02aabb3cd7148f9a38aa7806b8fa9e3/users/d6b968bcdb254336b92abc5313875a6b/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:42.780099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.780591 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.780710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.809640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] MFA Rules not processed for user `d6b968bcdb254336b92abc5313875a6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:42.810877 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:42.884322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1390/2781] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:42.890668 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:42.965591 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291ec86-4817-4052-8010-985533a8f41e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:42.970400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:42.971096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:42.971433 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:42.971658 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:42.972346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:42.974261 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.008071 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1392/2782] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:42 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:43.012064 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.031316 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f893cc-1f69-4af0-8644-9e54b3fd506a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.109223 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.109915 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.110274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.110553 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.111259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.113395 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.130259 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:43.137917 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1391/2783] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:43 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:05:43.142069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.153399 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c08de-61aa-4d26-bfda-338ef3712c61 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.160181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.161056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.161489 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.161901 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.162880 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.164606 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.193976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1393/2784] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:43.198709 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.211893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567c464-639b-4f66-ac37-b6e880c86790 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.216836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.218306 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.218612 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.218890 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] PATH_INFO: `/v3/projects/e418920a2fa34d57921e7f0d59e51530/users/c6ee93d600184218a251df8aa9573c0d/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.249833 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e418920a2fa34d57921e7f0d59e51530, user_id=c6ee93d600184218a251df8aa9573c0d, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.252690 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.273906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1392/2785] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:43 2022] PUT /identity/v3/projects/e418920a2fa34d57921e7f0d59e51530/users/c6ee93d600184218a251df8aa9573c0d/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:43.278307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.290871 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ee71d-0a8c-42fd-b40d-f1ebedbe3829 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.305715 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:43.366018 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d903fc2-7636-4117-adf6-45ec34c77180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.366952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903fc2-7636-4117-adf6-45ec34c77180 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.367333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903fc2-7636-4117-adf6-45ec34c77180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.367703 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d903fc2-7636-4117-adf6-45ec34c77180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.368735 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d903fc2-7636-4117-adf6-45ec34c77180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.372579 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d903fc2-7636-4117-adf6-45ec34c77180 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.383996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1394/2786] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:43 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:43.388962 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.401125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467bd950-92c4-46dd-9e0d-aa4e9f605644 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.405816 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.406755 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.407056 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.407578 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] PATH_INFO: `/v3/projects/e418920a2fa34d57921e7f0d59e51530/users/c6ee93d600184218a251df8aa9573c0d/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.409625 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e418920a2fa34d57921e7f0d59e51530, user_id=c6ee93d600184218a251df8aa9573c0d, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.412331 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.424139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1393/2787] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:43 2022] PUT /identity/v3/projects/e418920a2fa34d57921e7f0d59e51530/users/c6ee93d600184218a251df8aa9573c0d/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:43.495320 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.495545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.495814 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.529364 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] MFA Rules not processed for user `c6ee93d600184218a251df8aa9573c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:43.531193 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:43.611649 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1395/2788] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:43.624828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.627432 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:43.696844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa2151-5070-4a9a-977e-09e1b48b3d1c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.700685 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5fd4f-3f6a-4335-8f26-d5afa3189c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.701451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5fd4f-3f6a-4335-8f26-d5afa3189c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.701830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5fd4f-3f6a-4335-8f26-d5afa3189c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.702205 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5fd4f-3f6a-4335-8f26-d5afa3189c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.718772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5fd4f-3f6a-4335-8f26-d5afa3189c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.720822 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5fd4f-3f6a-4335-8f26-d5afa3189c67 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.732138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1394/2789] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:43.762953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:43.830332 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182199c-0d18-4b84-9479-eccc8c2cfb0c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:43.839919 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:43.840812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.841092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.841367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] PATH_INFO: `/v3/users/d6b968bcdb254336b92abc5313875a6b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.842612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6b968bcdb254336b92abc5313875a6b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:43.844559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:43.893788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:43.905003 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6b968bcdb254336b92abc5313875a6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:43.918045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6b968bcdb254336b92abc5313875a6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:43.927750 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6b968bcdb254336b92abc5313875a6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:43.928491 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6b968bcdb254336b92abc5313875a6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:43.936330 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6b968bcdb254336b92abc5313875a6b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:43.946956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1396/2790] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:43 2022] DELETE /identity/v3/users/d6b968bcdb254336b92abc5313875a6b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:43.952824 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:43.953304 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:43.953400 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:43.972708 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:43.973941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:44.046294 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1395/2791] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:44.057213 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:44.058813 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:44.126570 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c496d47-8f3e-4ad1-9ae4-921e1f41bad6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:44.130809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:44.131540 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:44.131900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:44.132157 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:44.146734 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:44.148665 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:44.160690 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1397/2792] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:44.468986 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:44.470699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:44.484641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90556c98-0907-43e4-83c3-d6d19d5384f9 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:44.489572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:44.490589 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:44.490876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:44.491238 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] PATH_INFO: `/v3/projects/a02aabb3cd7148f9a38aa7806b8fa9e3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:44.493265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02aabb3cd7148f9a38aa7806b8fa9e3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:44.495703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:44.547047 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02aabb3cd7148f9a38aa7806b8fa9e3', 'request_id': 'req-5dd01d5a-c933-479d-a50a-851cd9d04b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.554284 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02aabb3cd7148f9a38aa7806b8fa9e3', 'request_id': 'req-5dd01d5a-c933-479d-a50a-851cd9d04b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.558441 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:44.564459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02aabb3cd7148f9a38aa7806b8fa9e3', 'request_id': 'req-5dd01d5a-c933-479d-a50a-851cd9d04b3d'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.576413 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] The token cache is being invalidate because project a02aabb3cd7148f9a38aa7806b8fa9e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:44.576699 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.577324 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.578930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1396/2793] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:44 2022] DELETE /identity/v3/projects/a02aabb3cd7148f9a38aa7806b8fa9e3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:44.583201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:44.593223 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ed7a2-2dae-49a6-8564-e25c3681f60e service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:44.654435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:44.655344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:44.655620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:44.655891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] PATH_INFO: `/v3/users/c6ee93d600184218a251df8aa9573c0d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:44.657107 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ee93d600184218a251df8aa9573c0d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:44.659158 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:44.716449 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ee93d600184218a251df8aa9573c0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.725011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:44.730435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ee93d600184218a251df8aa9573c0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.740453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ee93d600184218a251df8aa9573c0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.741859 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ee93d600184218a251df8aa9573c0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.749362 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-804ec733-f71f-4b46-a310-72f82f8ab973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ee93d600184218a251df8aa9573c0d'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:44.756203 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1398/2794] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:05:44 2022] DELETE /identity/v3/users/c6ee93d600184218a251df8aa9573c0d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:45.057698 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.059200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:45.072444 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd01d5a-c933-479d-a50a-851cd9d04b3d admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.139724 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.140593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.140876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.141154 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] PATH_INFO: `/v3/projects/e418920a2fa34d57921e7f0d59e51530` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.142375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e418920a2fa34d57921e7f0d59e51530)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.144326 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.193089 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e418920a2fa34d57921e7f0d59e51530', 'request_id': 'req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:45.199559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e418920a2fa34d57921e7f0d59e51530', 'request_id': 'req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:45.208146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e418920a2fa34d57921e7f0d59e51530', 'request_id': 'req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:45.224034 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] The token cache is being invalidate because project e418920a2fa34d57921e7f0d59e51530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:05:45.224347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:45.225340 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-8837e1ab-bfbf-4dd5-94e6-6d88a04332c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:05:45.227258 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1397/2795] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:05:45 2022] DELETE /identity/v3/projects/e418920a2fa34d57921e7f0d59e51530 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:45.232787 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.233415 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.233561 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.265557 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:45.266826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:45.354214 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1399/2796] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:45.362123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.362429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.362740 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.384015 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:45.385241 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:45.402345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1398/2797] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:45.406785 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.418747 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60f359-2c9d-469d-b5ce-67dbc1faf0ed None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.424994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.425686 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.425978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.426307 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.427025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80223) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:05:45.427327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.429043 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.443121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1400/2798] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:05:45.448452 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.460483 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce34ead-c8c8-469e-8637-cc271681ca7a None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.469261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.469261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.469261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.469261 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.469639 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.470311 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.504830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1399/2799] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:45.506096 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.517045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624010e-2a3b-462c-afb2-3d67e7e66f07 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.584904 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.585509 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.585792 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.586068 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.586804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.588710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.618572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1401/2800] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:45.620019 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.631269 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb7240-9d96-4cf7-9fb6-19c74e8e1739 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.635858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.636528 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.636809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.637582 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.638322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.639988 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.654551 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1400/2801] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:45.658998 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.672150 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b898a3c8-d6bc-48a9-b926-9bfd5729e56c admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.678622 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716af4f1-4361-4e23-903c-dd51113d3719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.679326 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af4f1-4361-4e23-903c-dd51113d3719 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.679610 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af4f1-4361-4e23-903c-dd51113d3719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.679900 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716af4f1-4361-4e23-903c-dd51113d3719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.680628 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716af4f1-4361-4e23-903c-dd51113d3719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.682212 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716af4f1-4361-4e23-903c-dd51113d3719 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.693046 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1402/2802] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:45.697364 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.708286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853ba0a-b3ec-44a1-8da4-77cbcf70e59e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.713858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.715360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.715788 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.716144 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] PATH_INFO: `/v3/projects/9fc85835f63042129b79c8be061cbc45/users/043f56bf9da342fcbdf5871d0554a978/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.732743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fc85835f63042129b79c8be061cbc45, user_id=043f56bf9da342fcbdf5871d0554a978, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.735563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.750282 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1401/2803] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:45 2022] PUT /identity/v3/projects/9fc85835f63042129b79c8be061cbc45/users/043f56bf9da342fcbdf5871d0554a978/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:45.761405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.761815 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.762191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.792774 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] MFA Rules not processed for user `043f56bf9da342fcbdf5871d0554a978`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:45.793990 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:45.827857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:45.865507 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1403/2804] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:45.870109 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.885010 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:45.937080 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71c4dd-7fae-4764-b338-3375324724c7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:45.941976 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:45.942675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:45.942960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:45.943234 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:45.943956 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:45.945875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:45.979275 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1402/2805] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:45.982816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:45.994359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68bda-bcb4-4da0-bdd7-bcb43a6830d2 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.061197 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.061870 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.062147 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.062435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.063114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.065191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.091319 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1404/2806] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:45 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:46.095218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.106273 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7642de64-54c0-4415-a38c-7a27a695e2dc admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.111711 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.112387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.112671 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.112948 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.114411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.116116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.127672 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1403/2807] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:46.132311 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.143953 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a353b50-cd69-45ad-9f09-25eae1d9e558 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.149786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da376622-5c6f-4bae-b88d-2348a417d6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.150496 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376622-5c6f-4bae-b88d-2348a417d6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.150781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376622-5c6f-4bae-b88d-2348a417d6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.151056 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da376622-5c6f-4bae-b88d-2348a417d6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.151780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376622-5c6f-4bae-b88d-2348a417d6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.153404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da376622-5c6f-4bae-b88d-2348a417d6ca admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.164048 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1405/2808] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:46.168584 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.179217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1c355-d4ed-4685-a05b-fe70d3a40ea6 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.184206 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.185101 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.185359 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.185665 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] PATH_INFO: `/v3/projects/558b7e3b5eba46d29b5ca705db48103f/users/d9b438378ccb4bb6b96e5cebf4b99db6/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.200601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=558b7e3b5eba46d29b5ca705db48103f, user_id=d9b438378ccb4bb6b96e5cebf4b99db6, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.203286 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.219219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1404/2809] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:46 2022] PUT /identity/v3/projects/558b7e3b5eba46d29b5ca705db48103f/users/d9b438378ccb4bb6b96e5cebf4b99db6/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:05:46.232104 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.232400 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.232718 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.262045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] MFA Rules not processed for user `d9b438378ccb4bb6b96e5cebf4b99db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:46.263694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:46.335190 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1406/2810] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:46.340809 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.421438 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d93bd-38e8-4db2-9fc5-2a1fd556e8b1 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.426181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.426908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.427188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.427461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.428146 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.430051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.458540 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1405/2811] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:05:46 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:46.464575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.476872 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f46f8-f3f7-4bf8-90aa-3ec054d6d4b1 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.523037 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:46.544917 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.545593 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.545879 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.546157 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] PATH_INFO: `/v3/users` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.546891 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.548810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.571768 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1407/2812] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:05:46 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:05:46.577214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.595418 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4116afc1-586b-4d00-a7ef-670d59695ad7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.602407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.603137 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.603407 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.603702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.604493 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.606181 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.618663 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1406/2813] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:05:46.623156 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.637689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032d717-e53d-4f4f-a843-dad7a4866acf admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.643183 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.644097 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.644381 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.644656 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] PATH_INFO: `/v3/projects/c7b2799390fa495c9fce565251a13ef6/users/925730e8cdfe40ae8f27063d8079eb54/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.662198 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b2799390fa495c9fce565251a13ef6, user_id=925730e8cdfe40ae8f27063d8079eb54, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.664966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.680259 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1408/2814] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:46 2022] PUT /identity/v3/projects/c7b2799390fa495c9fce565251a13ef6/users/925730e8cdfe40ae8f27063d8079eb54/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:46.685017 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.698200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b301dc7-316f-49eb-936c-387370a86047 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.733163 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:46.760436 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0494f6-569a-41bc-9a8a-dcb0825f331d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.761132 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0494f6-569a-41bc-9a8a-dcb0825f331d admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.761410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0494f6-569a-41bc-9a8a-dcb0825f331d admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.761679 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0494f6-569a-41bc-9a8a-dcb0825f331d admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.762795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0494f6-569a-41bc-9a8a-dcb0825f331d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.764523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0494f6-569a-41bc-9a8a-dcb0825f331d admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.775410 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1407/2815] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 13 10:05:46.779858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.791949 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7795b12-d0e0-419e-bab2-b1350fe1f94e admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:46.797116 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:46.798021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.798297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.798651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] PATH_INFO: `/v3/projects/c7b2799390fa495c9fce565251a13ef6/users/925730e8cdfe40ae8f27063d8079eb54/roles/757ccd03cb5e4f109673558436a31b66` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.801015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b2799390fa495c9fce565251a13ef6, user_id=925730e8cdfe40ae8f27063d8079eb54, role_id=757ccd03cb5e4f109673558436a31b66)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:46.803741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:46.817511 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1409/2816] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:05:46 2022] PUT /identity/v3/projects/c7b2799390fa495c9fce565251a13ef6/users/925730e8cdfe40ae8f27063d8079eb54/roles/757ccd03cb5e4f109673558436a31b66 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:05:46.827906 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:46.828197 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:46.828472 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:46.859499 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] MFA Rules not processed for user `925730e8cdfe40ae8f27063d8079eb54`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:46.860677 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:46.941479 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1408/2817] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:05:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:46.953829 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:46.956696 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:47.027892 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfb41b8-8537-450b-a3aa-fc5ac5dbe42d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:47.031786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:47.032655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:47.033186 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:47.033651 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:47.105546 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:47.107574 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:47.124007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1410/2818] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:48.689581 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:48.700425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32cc0-673b-47a4-af87-da22ae07b9d8 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:48.704360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:48.705016 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:48.705296 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:48.705572 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:48.769925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:48.771880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:48.783082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1409/2819] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:49.346647 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:49.359533 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c83fd0-6368-43ff-aa35-2a8655b15bd5 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:49.368402 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9a6ab-eae0-4273-ad72-8608cda33dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:49.369218 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9a6ab-eae0-4273-ad72-8608cda33dbe service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:49.369592 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9a6ab-eae0-4273-ad72-8608cda33dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:49.372975 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9a6ab-eae0-4273-ad72-8608cda33dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:49.383141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9a6ab-eae0-4273-ad72-8608cda33dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:49.384765 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9a6ab-eae0-4273-ad72-8608cda33dbe service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:49.395621 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1411/2820] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:51.116332 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:51.119167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:51.135603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a106c6-117c-43ab-9b58-ad8bc12c5c4e service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:51.140366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:51.141035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:51.141313 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:51.141603 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:51.144310 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:51.205805 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:51.209489 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:51.211377 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:51.220811 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1410/2821] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:05:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:05:57.998669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:57.998669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:57.998669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:58.031752 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:05:58.033135 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:58.057781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:05:58.118786 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1412/2822] 10.222.0.17 () {58 vars in 1009 bytes} [Wed Jul 13 10:05:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:05:58.170920 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:05:58.173075 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:05:58.256908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb457-13b1-4680-b8ce-0d2a7f5421a1 service cinder] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:05:58.264336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:05:58.265180 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:05:58.265500 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:05:58.265806 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:05:58.276307 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:05:58.277947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:05:58.288274 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1411/2823] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:06:00.586775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:00.589482 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:00.859318 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:00.891274 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea4d1a-7eeb-4d86-9fec-27e6745d8287 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:00.896445 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:00.898477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:00.898477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:00.898477 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] PATH_INFO: `/v3/users/6c981a11a7fb4cdbb6d508e20b57e56a` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:00.899550 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c981a11a7fb4cdbb6d508e20b57e56a)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:00.901524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:00.956947 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ef2e3-1d2b-46f0-a16d-9cca00e5814a service swift] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:00.963440 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:00.964415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:00.964694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:00.964973 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] PATH_INFO: `/v3/users/043f56bf9da342fcbdf5871d0554a978` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:00.966217 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=043f56bf9da342fcbdf5871d0554a978)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:00.968239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:00.972547 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c981a11a7fb4cdbb6d508e20b57e56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:00.985749 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c981a11a7fb4cdbb6d508e20b57e56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.007955 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c981a11a7fb4cdbb6d508e20b57e56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.008689 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c981a11a7fb4cdbb6d508e20b57e56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.019537 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-3328d322-5276-4af2-bd4e-3ec9c8c30065 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c981a11a7fb4cdbb6d508e20b57e56a'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.025956 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1413/2824] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:00 2022] DELETE /identity/v3/users/6c981a11a7fb4cdbb6d508e20b57e56a => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:01.031110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:01.031640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:01.032129 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:01.051960 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:01.053452 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:01.065237 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043f56bf9da342fcbdf5871d0554a978'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.082710 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043f56bf9da342fcbdf5871d0554a978'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.101978 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:01.104091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043f56bf9da342fcbdf5871d0554a978'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.114166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043f56bf9da342fcbdf5871d0554a978'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.115481 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-ac3e828c-49c0-4a2d-8bb6-f8a5003be318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043f56bf9da342fcbdf5871d0554a978'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.123057 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1412/2825] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:00 2022] DELETE /identity/v3/users/043f56bf9da342fcbdf5871d0554a978 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:06:01.127694 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:01.128009 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:01.128347 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:01.136987 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:01.140145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1414/2826] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:06:01.153724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:01.154264 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:01.155282 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:01.155932 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:01.263795 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1413/2827] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:01.271770 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:01.274166 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:01.302810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd73fae2-109b-4c45-98f9-204bbbd56fa0 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:01.353308 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16909dcf-94e0-489a-a8b8-fdc5885d8b8b None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:01.357390 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d550e-874a-44b0-af5c-a59feea2d803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:01.358123 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d550e-874a-44b0-af5c-a59feea2d803 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:01.358505 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d550e-874a-44b0-af5c-a59feea2d803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:01.358859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d550e-874a-44b0-af5c-a59feea2d803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:01.375309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:01.376309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:01.376309 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:01.376522 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:01.381207 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d550e-874a-44b0-af5c-a59feea2d803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:01.382703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d550e-874a-44b0-af5c-a59feea2d803 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:01.389966 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:01.391524 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:01.398350 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1414/2828] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:01.400058 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a04b9-bdb8-4d4c-9625-cb3570a9bbe9 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:01.400414 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a04b9-bdb8-4d4c-9625-cb3570a9bbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:01.400758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a04b9-bdb8-4d4c-9625-cb3570a9bbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:01.423075 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1415/2829] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:01.423248 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-204a04b9-bdb8-4d4c-9625-cb3570a9bbe9 None None] MFA Rules not processed for user `364d2064ce3a4a3aae9643ec962e5395`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:01.424453 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-204a04b9-bdb8-4d4c-9625-cb3570a9bbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:01.504766 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1415/2830] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:01.871324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:01.873314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:01.889099 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbfc492-75c1-433b-80ad-8a74c58fe9a7 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:01.894093 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:01.895052 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:01.895342 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:01.895620 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] PATH_INFO: `/v3/projects/76cfb8153b36456bb87af6669461ad2d` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:01.897083 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=76cfb8153b36456bb87af6669461ad2d)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:01.899110 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:01.983327 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76cfb8153b36456bb87af6669461ad2d', 'request_id': 'req-deb4a153-7114-4302-939c-06ee49ba4c2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:01.993278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76cfb8153b36456bb87af6669461ad2d', 'request_id': 'req-deb4a153-7114-4302-939c-06ee49ba4c2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.006045 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76cfb8153b36456bb87af6669461ad2d', 'request_id': 'req-deb4a153-7114-4302-939c-06ee49ba4c2e'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.022775 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] The token cache is being invalidate because project 76cfb8153b36456bb87af6669461ad2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:02.023588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.024459 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-deb4a153-7114-4302-939c-06ee49ba4c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.028025 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1416/2831] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:01 2022] DELETE /identity/v3/projects/76cfb8153b36456bb87af6669461ad2d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:02.033927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.034411 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.034562 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.064363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:02.066918 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:02.150802 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=100 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:02.195199 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1416/2832] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:02.197991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.198541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.199064 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.210081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:02.231069 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:02.233111 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:02.243788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1417/2833] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:02.249342 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.263462 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c82fa5-c941-416b-9247-eed474532f4e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.269676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.270939 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.271568 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.272827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.273819 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:06:02.274338 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.276737 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.306182 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.315573 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1417/2834] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:06:02.317629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e08df8-b656-4d94-8035-d4ceac350dce None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.326987 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.327673 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.327957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.328225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.328920 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.331556 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.388301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1418/2835] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:06:02 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:06:02.389552 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.405772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1e0ce-758b-4fa1-8885-6d32892eb42c admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.433457 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.435336 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:02.530107 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.531449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.532618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.533676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.534626 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.537300 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.543429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d34ab-83f0-4e19-9c14-aff174d44c2f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.548898 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.549634 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.550020 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.550532 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] PATH_INFO: `/v3/projects/9fc85835f63042129b79c8be061cbc45` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.552015 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fc85835f63042129b79c8be061cbc45)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.554585 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.582508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1418/2836] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:06:02 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:06:02.591214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.603876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493ee75f-41fc-40f3-824a-43f6e466ab4f admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.611773 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.612463 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.612952 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.613239 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.614012 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.616179 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.628508 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1419/2837] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:06:02.632366 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.638800 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fc85835f63042129b79c8be061cbc45', 'request_id': 'req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.649200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fc85835f63042129b79c8be061cbc45', 'request_id': 'req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.653537 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683dea0-5ac9-45d6-a327-d2c62e3e2cf7 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.662795 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fc85835f63042129b79c8be061cbc45', 'request_id': 'req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.688207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] The token cache is being invalidate because project 9fc85835f63042129b79c8be061cbc45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:02.689911 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.690810 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.693732 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1419/2838] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:02 2022] DELETE /identity/v3/projects/9fc85835f63042129b79c8be061cbc45 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:02.698160 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.699828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:02.764712 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.765828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.766630 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.767030 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.768327 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.769521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.786201 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1420/2839] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:06:02 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:06:02.787930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:02.789967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:02.807827 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba43e69-1cbf-4504-8f0d-d81874444a1b admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.813601 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a58aa0-800a-4858-81ad-035ca28a8de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.815333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58aa0-800a-4858-81ad-035ca28a8de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.815804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58aa0-800a-4858-81ad-035ca28a8de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.816645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a58aa0-800a-4858-81ad-035ca28a8de8 admin admin] PATH_INFO: `/v3/projects/60f5819f7c4d4404b0f654a6b3668ead/users/db6f5e7ddf814097b7caf53025f3219f/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.827602 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6d0b4f-cf6c-42ac-98b7-afee69f0e162 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:02.836727 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a58aa0-800a-4858-81ad-035ca28a8de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f5819f7c4d4404b0f654a6b3668ead, user_id=db6f5e7ddf814097b7caf53025f3219f, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.839775 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a58aa0-800a-4858-81ad-035ca28a8de8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.849843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:02.850799 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.851112 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.851344 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] PATH_INFO: `/v3/users/d9b438378ccb4bb6b96e5cebf4b99db6` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.852817 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9b438378ccb4bb6b96e5cebf4b99db6)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:02.854862 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:02.870850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1421/2840] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:06:02 2022] PUT /identity/v3/projects/60f5819f7c4d4404b0f654a6b3668ead/users/db6f5e7ddf814097b7caf53025f3219f/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:02.875406 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:02.878255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:02.878791 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:02.879678 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:02.921255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] MFA Rules not processed for user `db6f5e7ddf814097b7caf53025f3219f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:02.922315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:02.941659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9b438378ccb4bb6b96e5cebf4b99db6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.955198 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:02.964367 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9b438378ccb4bb6b96e5cebf4b99db6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.979340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9b438378ccb4bb6b96e5cebf4b99db6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.980118 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9b438378ccb4bb6b96e5cebf4b99db6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:02.994940 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9b438378ccb4bb6b96e5cebf4b99db6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:03.005741 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1420/2841] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:02 2022] DELETE /identity/v3/users/d9b438378ccb4bb6b96e5cebf4b99db6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:03.051759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1422/2842] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:03.061145 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:03.063858 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:03.180781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727da8a-5423-4b77-a5c2-20efd38b3a8b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:03.189897 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2947dfd2c2b14daf9c16e534b0139da5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:03.190828 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:03.191180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:03.192039 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:03.313392 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:03.315302 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:03.326127 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1421/2843] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:03.492374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:03.494927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:03.620490 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d26b5-12d2-4b0c-b424-c310fd32c45c None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:03.736764 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:03.737830 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:03.738187 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:03.738596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] PATH_INFO: `/v3/projects/558b7e3b5eba46d29b5ca705db48103f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:03.740003 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] RBAC: Authorizing `identity:delete_project(project_id=558b7e3b5eba46d29b5ca705db48103f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:03.742040 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:03.839747 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '558b7e3b5eba46d29b5ca705db48103f', 'request_id': 'req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:03.849098 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '558b7e3b5eba46d29b5ca705db48103f', 'request_id': 'req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:03.859688 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '558b7e3b5eba46d29b5ca705db48103f', 'request_id': 'req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:03.874623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:03.881082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] The token cache is being invalidate because project 558b7e3b5eba46d29b5ca705db48103f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:03.881082 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:03.882670 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:03.889026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1423/2844] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:03 2022] DELETE /identity/v3/projects/558b7e3b5eba46d29b5ca705db48103f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:03.890334 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:03.909580 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f9a0f-c668-44a9-b96d-4d9640d77282 service glance] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:03.915169 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:03.917235 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:03.974403 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:04.013492 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:04.016421 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:04.016710 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:04.016994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] PATH_INFO: `/v3/users/925730e8cdfe40ae8f27063d8079eb54` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:04.024100 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] RBAC: Authorizing `identity:delete_user(user_id=925730e8cdfe40ae8f27063d8079eb54)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:04.026359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:04.128941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f5950-e1e2-422d-a1f3-9372dbe4174a admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:04.131652 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '925730e8cdfe40ae8f27063d8079eb54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.143236 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:04.143908 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:04.144192 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:04.144473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:04.148385 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:04.157027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '925730e8cdfe40ae8f27063d8079eb54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.165429 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:04.167028 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:04.170167 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '925730e8cdfe40ae8f27063d8079eb54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.171687 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '925730e8cdfe40ae8f27063d8079eb54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.180869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '925730e8cdfe40ae8f27063d8079eb54'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.182450 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1424/2845] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:04.203516 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1422/2846] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:03 2022] DELETE /identity/v3/users/925730e8cdfe40ae8f27063d8079eb54 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:04.647604 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:04.652191 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:04.681425 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0a2a4-a993-483c-9068-4d6f1a4df435 service placement] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:04.758431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:04.759381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:04.759754 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:04.760037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] PATH_INFO: `/v3/projects/c7b2799390fa495c9fce565251a13ef6` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:04.761448 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b2799390fa495c9fce565251a13ef6)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:04.764334 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:04.837875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b2799390fa495c9fce565251a13ef6', 'request_id': 'req-222d4146-c540-4e50-a11d-ef3fa7b0e54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.855645 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b2799390fa495c9fce565251a13ef6', 'request_id': 'req-222d4146-c540-4e50-a11d-ef3fa7b0e54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.868381 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b2799390fa495c9fce565251a13ef6', 'request_id': 'req-222d4146-c540-4e50-a11d-ef3fa7b0e54e'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.877315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:04.886944 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] The token cache is being invalidate because project c7b2799390fa495c9fce565251a13ef6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:04.887554 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.890899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-222d4146-c540-4e50-a11d-ef3fa7b0e54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:04.902468 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1425/2847] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:04 2022] DELETE /identity/v3/projects/c7b2799390fa495c9fce565251a13ef6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:14.196278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:14.894750 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:19.261435 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:19.263447 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:19.323727 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd5bfa-c1f7-4968-ba50-dc2ba4db6dea admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:19.377427 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:19.378091 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:19.378366 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:19.378725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:19.381236 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:19.449612 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:19.451178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:19.462154 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1423/2848] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:19.773925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:19.774475 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:19.774635 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:19.794214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] MFA Rules not processed for user `ed4faddf2f4d4b6fa1d61c8a276724e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:19.795529 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:19.851758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1426/2849] 10.222.0.17 () {58 vars in 967 bytes} [Wed Jul 13 10:06:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:19.865683 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:19.867138 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:19.943905 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f47a33-975b-47d4-a617-afe11b7dc198 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:19.949249 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad683d737d594402850ef0af27d6e103', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:19.949845 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:19.950131 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:19.950438 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:19.957044 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=100 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:19.961022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:19.963661 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:19.973293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1424/2850] 10.222.0.17 () {60 vars in 1384 bytes} [Wed Jul 13 10:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 13 10:06:22.000141 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.002218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:22.078320 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce10bcd-79fe-4c1f-886e-8da5cd51ef49 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.084457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.085363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.085644 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.086590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] PATH_INFO: `/v3/users/23e88113582f4866b2e322b1afd20ec3` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.087880 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e88113582f4866b2e322b1afd20ec3)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.089844 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.153004 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e88113582f4866b2e322b1afd20ec3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.167164 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e88113582f4866b2e322b1afd20ec3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.178859 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e88113582f4866b2e322b1afd20ec3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.185929 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e88113582f4866b2e322b1afd20ec3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.186637 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-c4888adc-5b30-4396-b253-138a889c6a47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e88113582f4866b2e322b1afd20ec3'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.192943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1427/2851] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:21 2022] DELETE /identity/v3/users/23e88113582f4866b2e322b1afd20ec3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:22.390640 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.403559 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6046a1a5-6bbc-454d-bd7a-8397e9c784ff service swift] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.466013 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.466910 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.467191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.467464 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] PATH_INFO: `/v3/projects/1c80ba395e6141b7a102fe4bfdc427c2` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.468780 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c80ba395e6141b7a102fe4bfdc427c2)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.470808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.523844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c80ba395e6141b7a102fe4bfdc427c2', 'request_id': 'req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.530202 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c80ba395e6141b7a102fe4bfdc427c2', 'request_id': 'req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.540050 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c80ba395e6141b7a102fe4bfdc427c2', 'request_id': 'req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.550856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] The token cache is being invalidate because project 1c80ba395e6141b7a102fe4bfdc427c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:22.551177 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.551890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f87136aa-a2b1-4c92-a1bd-7db6d7fc87f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:22.553812 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1425/2852] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:22 2022] DELETE /identity/v3/projects/1c80ba395e6141b7a102fe4bfdc427c2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:22.559099 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.559415 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.559675 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.578702 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:22.579927 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:22.599925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:22.644245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1428/2853] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:22.656554 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.656854 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.657297 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.683945 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:22.685142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:22.694453 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1426/2854] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:22.699641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.713139 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668d54-56a8-4db7-9c61-ca432525298e None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.718967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.719629 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.719913 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.720188 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.720924 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:06:22.721233 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.722883 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.735794 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1429/2855] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:06:22.740816 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.750688 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474ef8e-2d3d-4956-813a-ad16c2f09f1c None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.756339 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.756988 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.757269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.757545 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.758230 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.760165 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.788761 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1427/2856] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:06:22 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:06:22.792925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.803849 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9ccf6-ee71-4916-b579-5f64a393fb8e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.865828 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.866532 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.866823 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.867097 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.867792 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.869759 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.891346 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1430/2857] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:06:22 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:06:22.895597 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.906305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d94fee-775b-493e-87f4-dc068288a1dd admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.912014 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.912595 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.912876 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.913146 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.913869 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.915484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.929283 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1428/2858] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:06:22.935220 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.948967 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306b217f-83b4-4c78-babd-793fdd44e13e admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.954865 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def8e7a8-303f-4f73-a327-4542919e5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.955545 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e7a8-303f-4f73-a327-4542919e5046 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.955821 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e7a8-303f-4f73-a327-4542919e5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.956113 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def8e7a8-303f-4f73-a327-4542919e5046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:22.956838 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e7a8-303f-4f73-a327-4542919e5046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:22.958461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def8e7a8-303f-4f73-a327-4542919e5046 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:22.969936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1431/2859] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:06:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:06:22.974465 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:22.985944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d91fd-d35f-4c00-9b05-a6a69b5a2810 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:22.991811 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:22.992694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:22.992968 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:22.993242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] PATH_INFO: `/v3/projects/b622429b689e4f9db4d220cab58bfd37/users/92b0bfa297974e8abded2a120406693f/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:23.013181 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b622429b689e4f9db4d220cab58bfd37, user_id=92b0bfa297974e8abded2a120406693f, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:23.015857 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:23.031571 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1429/2860] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:06:22 2022] PUT /identity/v3/projects/b622429b689e4f9db4d220cab58bfd37/users/92b0bfa297974e8abded2a120406693f/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:23.041847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:23.042315 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:23.042449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:23.070804 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] MFA Rules not processed for user `92b0bfa297974e8abded2a120406693f`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:23.072006 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:23.138812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1432/2861] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:23.150383 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:23.152216 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:23.178928 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:23.236220 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d517e-6d08-4fa9-88c6-190c3a6fcc1f admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:23.240051 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e808e-556f-4fad-80a5-79a8e373140a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:23.240733 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e808e-556f-4fad-80a5-79a8e373140a service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:23.240994 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e808e-556f-4fad-80a5-79a8e373140a service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:23.241273 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e808e-556f-4fad-80a5-79a8e373140a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:23.254011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e808e-556f-4fad-80a5-79a8e373140a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:23.255951 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e808e-556f-4fad-80a5-79a8e373140a service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:23.265484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1430/2862] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:23 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:33.135245 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=88,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:33.260952 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=25 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:33.461778 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:33.531925 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de19a3-1b4a-4ab0-8338-8c0aeb941b79 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:33.536703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:33.537590 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:33.537894 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:33.538189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] PATH_INFO: `/v3/users/92b0bfa297974e8abded2a120406693f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:33.539434 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92b0bfa297974e8abded2a120406693f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:33.541426 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:33.592495 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92b0bfa297974e8abded2a120406693f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:33.605593 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92b0bfa297974e8abded2a120406693f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:33.613693 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92b0bfa297974e8abded2a120406693f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:33.621345 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92b0bfa297974e8abded2a120406693f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:33.621941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92b0bfa297974e8abded2a120406693f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:33.628041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1433/2863] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:33 2022] DELETE /identity/v3/users/92b0bfa297974e8abded2a120406693f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:33.633049 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:33.633333 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:33.633609 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:33.653137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:33.654345 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:33.724149 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1431/2864] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 13 10:06:33.737736 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:33.739523 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:33.806588 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62400db6-3164-4402-a273-43abd269a9a9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:33.810935 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:33.811615 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:33.811898 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:33.812172 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:33.822996 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:33.824473 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:33.834812 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1434/2865] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:34.146781 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:34.148541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:34.161021 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d43c72-f133-4d92-8a76-978d927aa2f6 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:34.165962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:34.166896 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:34.167175 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:34.167448 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] PATH_INFO: `/v3/projects/b622429b689e4f9db4d220cab58bfd37` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:34.169443 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b622429b689e4f9db4d220cab58bfd37)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:34.171685 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:34.220989 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b622429b689e4f9db4d220cab58bfd37', 'request_id': 'req-aecd5647-290b-419b-b2ba-c86cccf2488b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:34.227248 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b622429b689e4f9db4d220cab58bfd37', 'request_id': 'req-aecd5647-290b-419b-b2ba-c86cccf2488b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:34.235977 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b622429b689e4f9db4d220cab58bfd37', 'request_id': 'req-aecd5647-290b-419b-b2ba-c86cccf2488b'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:34.247017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] The token cache is being invalidate because project b622429b689e4f9db4d220cab58bfd37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:34.247306 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:34.247923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-aecd5647-290b-419b-b2ba-c86cccf2488b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:34.249478 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1432/2866] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:34 2022] DELETE /identity/v3/projects/b622429b689e4f9db4d220cab58bfd37 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:43.560301 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:43.561974 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:43.575914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f35a43-0fb0-49fe-bd83-110b6ebeff7a service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:43.595985 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:43.635851 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:43.636653 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:43.637343 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:43.637616 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] PATH_INFO: `/v3/users/db6f5e7ddf814097b7caf53025f3219f` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:43.638954 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db6f5e7ddf814097b7caf53025f3219f)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:43.640868 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:43.691619 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db6f5e7ddf814097b7caf53025f3219f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:43.705247 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db6f5e7ddf814097b7caf53025f3219f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:43.714459 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db6f5e7ddf814097b7caf53025f3219f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:43.721876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db6f5e7ddf814097b7caf53025f3219f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:43.722648 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db6f5e7ddf814097b7caf53025f3219f'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:43.728941 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1435/2867] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:06:43 2022] DELETE /identity/v3/users/db6f5e7ddf814097b7caf53025f3219f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:43.733890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:43.734398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:43.734398 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:43.754289 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:43.755549 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:43.822279 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1433/2868] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:43.834569 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:43.836922 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:43.899297 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01567ff3-5c23-4235-8e5e-69e3fb7da607 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:43.903454 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84b3c5-de24-41b3-821b-e7f0e9cb5e24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:43.904095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b3c5-de24-41b3-821b-e7f0e9cb5e24 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:43.904374 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b3c5-de24-41b3-821b-e7f0e9cb5e24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:43.904623 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84b3c5-de24-41b3-821b-e7f0e9cb5e24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:43.914858 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b3c5-de24-41b3-821b-e7f0e9cb5e24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:43.916281 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84b3c5-de24-41b3-821b-e7f0e9cb5e24 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:43.927497 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1436/2869] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:44.218973 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.220469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:44.234390 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ed54a-77a7-4fd5-9c4a-dd023442b3eb None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.239278 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.240275 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.240553 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.240843 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] PATH_INFO: `/v3/projects/60f5819f7c4d4404b0f654a6b3668ead` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.242027 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f5819f7c4d4404b0f654a6b3668ead)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.243962 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.266588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:44.295081 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f5819f7c4d4404b0f654a6b3668ead', 'request_id': 'req-cdd9700e-802a-43a8-b520-52f07a35ce1f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:44.301265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f5819f7c4d4404b0f654a6b3668ead', 'request_id': 'req-cdd9700e-802a-43a8-b520-52f07a35ce1f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:44.310293 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f5819f7c4d4404b0f654a6b3668ead', 'request_id': 'req-cdd9700e-802a-43a8-b520-52f07a35ce1f'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:44.321030 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] The token cache is being invalidate because project 60f5819f7c4d4404b0f654a6b3668ead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:06:44.321324 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:44.322041 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-cdd9700e-802a-43a8-b520-52f07a35ce1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:06:44.323659 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1434/2870] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:06:44 2022] DELETE /identity/v3/projects/60f5819f7c4d4404b0f654a6b3668ead => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:06:44.329138 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.329427 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.329703 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.348195 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:44.349419 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:44.395887 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:44.418610 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1437/2871] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:44.427694 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.427991 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.428265 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.447498 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:44.448706 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:44.456838 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1435/2872] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:44.461322 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.472451 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abfc1d-f02c-43f8-a58c-00dd2be81f51 None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.478910 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.479651 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.479936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.480212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.481213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80222) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 13 10:06:44.481521 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.483208 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.495457 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1438/2873] 10.222.0.17 () {58 vars in 1152 bytes} [Wed Jul 13 10:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 13 10:06:44.500178 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.510314 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac0ac2-0985-4e90-9e44-b71556123050 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.515908 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.516568 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.516844 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.517120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.517806 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.519730 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.547725 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1436/2874] 10.222.0.17 () {60 vars in 1152 bytes} [Wed Jul 13 10:06:44 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 13 10:06:44.553743 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.564253 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed28df-a9a1-411e-8e2d-8a3a84064dc9 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.622268 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.622960 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.623240 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.623517 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] PATH_INFO: `/v3/users` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.624218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.626177 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.648218 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1439/2875] 10.222.0.17 () {60 vars in 1143 bytes} [Wed Jul 13 10:06:44 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 13 10:06:44.652514 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.663246 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3050c3a-7d2b-4e81-8924-7294184877f0 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.668114 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.668996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.669189 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.669484 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] PATH_INFO: `/v3/roles` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.670201 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.671808 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.683185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1437/2876] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:06:44.689749 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.700643 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d294e1c-70c8-4f79-b43c-546e33260686 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.705563 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a271c40-2924-46df-a24a-641c82a6863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.706212 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a271c40-2924-46df-a24a-641c82a6863b admin admin] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.706520 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a271c40-2924-46df-a24a-641c82a6863b admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.706796 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a271c40-2924-46df-a24a-641c82a6863b admin admin] PATH_INFO: `/v3/roles` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.707510 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a271c40-2924-46df-a24a-641c82a6863b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.709094 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a271c40-2924-46df-a24a-641c82a6863b admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.720461 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1440/2877] 10.222.0.17 () {58 vars in 1121 bytes} [Wed Jul 13 10:06:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 13 10:06:44.724890 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.736343 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a0b31-4d89-4632-8d6f-72bbaf4b3763 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.742560 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.743469 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.743740 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.744017 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] PATH_INFO: `/v3/projects/ca261646cd8b464fb9a8d4f855873c16/users/659a71543d59426093893f2cb964d0d7/roles/d5d3a107e30e45e0a7a53f71de611f4b` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.760470 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca261646cd8b464fb9a8d4f855873c16, user_id=659a71543d59426093893f2cb964d0d7, role_id=d5d3a107e30e45e0a7a53f71de611f4b)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.763519 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.779933 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1438/2878] 10.222.0.17 () {60 vars in 1482 bytes} [Wed Jul 13 10:06:44 2022] PUT /identity/v3/projects/ca261646cd8b464fb9a8d4f855873c16/users/659a71543d59426093893f2cb964d0d7/roles/d5d3a107e30e45e0a7a53f71de611f4b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:06:44.785162 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304362-f50c-49f3-8fbb-b16ea494a29c None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.785498 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304362-f50c-49f3-8fbb-b16ea494a29c None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.785789 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72304362-f50c-49f3-8fbb-b16ea494a29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.805329 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-72304362-f50c-49f3-8fbb-b16ea494a29c None None] MFA Rules not processed for user `7a11b13b53364a13a16a1b29e3946ed6`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:44.806575 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-72304362-f50c-49f3-8fbb-b16ea494a29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:44.875955 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1441/2879] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:44.888914 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:44.891200 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:44.953404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8752c0-96d5-43b2-9093-838a70e58c9b admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:44.957655 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:44.958292 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:44.958601 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:44.958877 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:44.968794 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:44.970207 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:44.979923 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1439/2880] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:45.880618 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec178-2b14-4b16-a281-60d81b276dd7 None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:45.881176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec178-2b14-4b16-a281-60d81b276dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:45.881176 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bec178-2b14-4b16-a281-60d81b276dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:45.908265 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-80bec178-2b14-4b16-a281-60d81b276dd7 None None] MFA Rules not processed for user `659a71543d59426093893f2cb964d0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:45.909516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-80bec178-2b14-4b16-a281-60d81b276dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:45.953068 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:45.980127 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1442/2881] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:45.990865 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:06:45.992407 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:46.058359 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:46.066016 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608fa4a-a244-4e86-b31f-e4e7bf6b0181 service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:06:46.070856 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:06:46.071535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:46.071851 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:46.072414 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:46.083380 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:06:46.085137 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:06:46.096346 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1440/2882] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:06:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:06:47.452189 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] REQUEST_METHOD: `POST` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:06:47.452742 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:06:47.452847 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:06:47.472041 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.auth.core [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] MFA Rules not processed for user `659a71543d59426093893f2cb964d0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80222) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:06:47.473360 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:06:47.481336 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1443/2883] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:06:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:06:56.092092 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=5 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:06:57.466213 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=12 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:07:39.401404 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:07:39.415208 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75a9048-d9f4-4874-ae14-e71f96aaea23 service cinder] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:07:39.420063 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bda80f77ff46908f3011622beb3e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:07:39.420701 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:07:39.420985 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:07:39.421260 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:07:39.423430 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:07:39.521429 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:07:39.522944 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13d500-e1b5-4278-ace9-d5528ba4a156 service cinder] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:07:39.545022 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1441/2884] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:07:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:07:42.234171 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:07:42.245772 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4ca8b-ca96-4916-afce-d46785da5d8f None None] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:07:42.249449 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:07:42.250095 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:07:42.250375 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:07:42.250681 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:07:42.252734 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:07:42.267943 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:07:42.269369 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:07:42.281559 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1444/2885] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:07:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:07:49.541957 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=43 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:07:52.275899 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:07:54.419361 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] REQUEST_METHOD: `POST` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:07:54.419849 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:07:54.419947 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:07:54.438180 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.auth.core [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] MFA Rules not processed for user `659a71543d59426093893f2cb964d0d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80223) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 13 10:07:54.439422 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:07:54.447210 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1442/2886] 10.222.0.17 () {58 vars in 957 bytes} [Wed Jul 13 10:07:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 13 10:08:02.127981 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:02.137516 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dcf46-ab4b-4093-9092-13da1735d600 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:02.142636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:02.143289 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:02.143776 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:02.144055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:02.146045 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:02.157167 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:02.158636 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:02.167225 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1445/2887] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:08:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:08:04.433007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=3 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:08:12.163686 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=6 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:08:15.359676 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:15.371970 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fab9b47-90e4-4742-a23a-560982605131 None None] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:15.375830 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '70b8ca3066c649469fd409cae3fe9627', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:15.376535 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:15.377141 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:15.377418 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:15.379225 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:15.393188 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:15.394790 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:15.405654 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1443/2888] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:08:22.013161 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:22.014716 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:22.030605 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107ab05-9da7-499e-aff2-d7978fdb13c7 service neutron] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:22.036200 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:22.037078 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:22.037363 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:22.037641 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] PATH_INFO: `/v3/users/364d2064ce3a4a3aae9643ec962e5395` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:22.038914 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=364d2064ce3a4a3aae9643ec962e5395)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:22.040876 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:22.090692 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364d2064ce3a4a3aae9643ec962e5395'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.103431 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364d2064ce3a4a3aae9643ec962e5395'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.113087 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364d2064ce3a4a3aae9643ec962e5395'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.120367 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364d2064ce3a4a3aae9643ec962e5395'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.121011 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364d2064ce3a4a3aae9643ec962e5395'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.127037 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1446/2889] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:08:22 2022] DELETE /identity/v3/users/364d2064ce3a4a3aae9643ec962e5395 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:08:22.321967 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:22.333766 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b33cb8-b5e1-4aba-8064-901a2b9d0ebd service neutron] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:22.402939 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:22.403836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:22.404121 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:22.404401 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] PATH_INFO: `/v3/projects/73c5b860ab454ad19f1a1217045aa988` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:22.405633 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c5b860ab454ad19f1a1217045aa988)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:22.407583 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:22.456301 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c5b860ab454ad19f1a1217045aa988', 'request_id': 'req-4217121a-c945-471e-aea6-363b1cb64f56'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.462684 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c5b860ab454ad19f1a1217045aa988', 'request_id': 'req-4217121a-c945-471e-aea6-363b1cb64f56'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.472629 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c5b860ab454ad19f1a1217045aa988', 'request_id': 'req-4217121a-c945-471e-aea6-363b1cb64f56'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.484724 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] The token cache is being invalidate because project 73c5b860ab454ad19f1a1217045aa988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:08:22.485011 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.485669 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.487316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1444/2890] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:08:22 2022] DELETE /identity/v3/projects/73c5b860ab454ad19f1a1217045aa988 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:08:22.491387 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:22.492848 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:22.507005 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262c668-bebc-4c4e-9b07-9249472c42c3 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:22.570024 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:22.571035 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:22.571394 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:22.571836 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] PATH_INFO: `/v3/users/78c8df4238cd4df0a01754090d5bbf55` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:22.573116 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c8df4238cd4df0a01754090d5bbf55)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:22.575219 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:22.622873 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c8df4238cd4df0a01754090d5bbf55'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.635561 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c8df4238cd4df0a01754090d5bbf55'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.644596 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c8df4238cd4df0a01754090d5bbf55'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.646829 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:08:22.654051 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c8df4238cd4df0a01754090d5bbf55'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.654893 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c8df4238cd4df0a01754090d5bbf55'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.661279 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1447/2891] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:08:22 2022] DELETE /identity/v3/users/78c8df4238cd4df0a01754090d5bbf55 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 13 10:08:22.845316 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:22.846804 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:22.860972 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217121a-c945-471e-aea6-363b1cb64f56 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:22.921616 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:22.922555 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:22.922842 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:22.923120 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] PATH_INFO: `/v3/projects/859d2901d15f409bb695482cb77b6f18` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:22.924836 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859d2901d15f409bb695482cb77b6f18)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:22.926809 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:22.948393 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:08:22.979191 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859d2901d15f409bb695482cb77b6f18', 'request_id': 'req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:22.988269 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859d2901d15f409bb695482cb77b6f18', 'request_id': 'req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:23.000575 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859d2901d15f409bb695482cb77b6f18', 'request_id': 'req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:23.012271 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] The token cache is being invalidate because project 859d2901d15f409bb695482cb77b6f18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80223) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:08:23.012541 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:23.013211 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:23.014913 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1445/2892] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:08:22 2022] DELETE /identity/v3/projects/859d2901d15f409bb695482cb77b6f18 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:08:26.005255 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:26.007026 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:26.095978 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe7b94-eecc-4d1e-bf3a-b61abeb0b598 admin admin] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:26.173777 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '339f9bc083674bf897023509101fc7dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:26.174753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] REQUEST_METHOD: `GET` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:26.174753 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:26.175055 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:26.176930 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.fernet_utils [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80222) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:26.190091 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:26.191758 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:26.203125 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1448/2893] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:08:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:08:33.009007 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:08:36.198333 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=66 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:08:50.452882 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:50.454405 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:08:50.524113 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82e0a97-bf54-4188-8d22-85e8d43b1ad6 admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:50.532777 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:50.534040 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:50.534471 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:50.534826 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] PATH_INFO: `/v3/users/659a71543d59426093893f2cb964d0d7` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:50.536788 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] RBAC: Authorizing `identity:delete_user(user_id=659a71543d59426093893f2cb964d0d7)` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:50.539373 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:50.590472 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '659a71543d59426093893f2cb964d0d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.601996 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '659a71543d59426093893f2cb964d0d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.610618 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '659a71543d59426093893f2cb964d0d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.611242 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '659a71543d59426093893f2cb964d0d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.618588 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.notifications [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '659a71543d59426093893f2cb964d0d7'} {{(pid=80223) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.624772 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1446/2894] 10.222.0.17 () {58 vars in 1223 bytes} [Wed Jul 13 10:08:50 2022] DELETE /identity/v3/users/659a71543d59426093893f2cb964d0d7 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:08:50.821487 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] Authenticating user token {{(pid=80222) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:08:50.832850 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc0f8-59a3-4e04-9634-26cdf4cfcde9 service nova] Validating token access rules against request {{(pid=80222) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:08:50.896936 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a11b13b53364a13a16a1b29e3946ed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a135dccee4ed45239317c87dab2bda38', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80222) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:08:50.897875 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:08:50.898151 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:08:50.898446 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] PATH_INFO: `/v3/projects/ca261646cd8b464fb9a8d4f855873c16` {{(pid=80222) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:08:50.899640 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca261646cd8b464fb9a8d4f855873c16)` {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:08:50.901583 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] RBAC: Authorization granted {{(pid=80222) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:08:50.950174 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca261646cd8b464fb9a8d4f855873c16', 'request_id': 'req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.956541 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca261646cd8b464fb9a8d4f855873c16', 'request_id': 'req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.967617 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca261646cd8b464fb9a8d4f855873c16', 'request_id': 'req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8'} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.978713 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] The token cache is being invalidate because project ca261646cd8b464fb9a8d4f855873c16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80222) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 13 10:08:50.978994 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.980214 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG keystone.notifications [None req-443bcd1d-88d5-40b6-83a0-b67ef95d1de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80222) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 13 10:08:50.981771 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: [pid: 80222|app: 0|req: 1449/2895] 10.222.0.17 () {58 vars in 1232 bytes} [Wed Jul 13 10:08:50 2022] DELETE /identity/v3/projects/ca261646cd8b464fb9a8d4f855873c16 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 13 10:09:00.621340 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:09:00.975676 dv-cinder-797608-57-iscsi devstack@keystone.service[80222]: DEBUG dbcounter [-] [80222] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80222) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 13 10:11:53.130280 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Authenticating user token {{(pid=80223) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 13 10:11:53.131965 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:11:53.215572 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa5fcb-863d-4d6e-b911-5a338915124d admin admin] Validating token access rules against request {{(pid=80223) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 13 10:11:53.279976 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b89a3526406c42819414b773fe8663ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5a38e8abe0ab4906affbfcd35e3a1d04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80223) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 13 10:11:53.280627 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] REQUEST_METHOD: `GET` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 13 10:11:53.280932 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] SCRIPT_NAME: `/identity` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 13 10:11:53.281185 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80223) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 13 10:11:53.283142 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.fernet_utils [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80223) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 13 10:11:53.294305 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 13 10:11:53.295916 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa03a17-1650-42a0-a8f0-89b96996134d service placement] RBAC: Authorization granted {{(pid=80223) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 13 10:11:53.308981 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: [pid: 80223|app: 0|req: 1447/2896] 10.222.0.17 () {60 vars in 1365 bytes} [Wed Jul 13 10:11:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 13 10:12:03.301950 dv-cinder-797608-57-iscsi devstack@keystone.service[80223]: DEBUG dbcounter [-] [80223] Writing DB stats keystone:SELECT=58 {{(pid=80223) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}